-- Logs begin at Thu 2022-07-07 14:32:42 UTC, end at Thu 2022-07-07 15:50:49 UTC. -- Jul 07 15:24:25.900709 dv-cinder-841302-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 07 15:24:25.909315 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 15:24:25 2022] *** Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: nodename: dv-cinder-841302-5-iscsi Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: machine: x86_64 Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: clock source: unix Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: pcre jit disabled Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: detected number of CPU cores: 4 Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: current working directory: / Jul 07 15:24:25.911342 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: detected binary path: /usr/bin/uwsgi-core Jul 07 15:24:25.912127 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: your processes number limit is 47680 Jul 07 15:24:25.912127 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: your memory page size is 4096 bytes Jul 07 15:24:25.912127 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: detected max file descriptor number: 2048 Jul 07 15:24:25.912127 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: lock engine: pthread robust mutexes Jul 07 15:24:25.912127 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: thunder lock: enabled Jul 07 15:24:25.912127 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 07 15:24:25.912127 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 15:24:25.955048 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: Python main interpreter initialized at 0x562c2d7a99c0 Jul 07 15:24:25.955048 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: python threads support enabled Jul 07 15:24:25.955048 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: your server socket listen backlog is limited to 100 connections Jul 07 15:24:25.955048 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: your mercy for graceful operations on workers is 90 seconds Jul 07 15:24:25.955397 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 15:24:25.955478 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: *** Operational MODE: preforking *** Jul 07 15:24:25.955751 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: *** uWSGI is running in multiple interpreter mode *** Jul 07 15:24:25.955751 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: spawned uWSGI master process (pid: 103546) Jul 07 15:24:25.955950 dv-cinder-841302-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 07 15:24:25.956747 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: spawned uWSGI worker 1 (pid: 103549, cores: 1) Jul 07 15:24:25.958776 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: spawned uWSGI worker 2 (pid: 103550, cores: 1) Jul 07 15:24:25.958776 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 15:24:26.613242 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 15:24:26.622701 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 15:24:27.735767 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 15:24:27.735767 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: from cryptography.utils import int_from_bytes Jul 07 15:24:27.736484 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 15:24:27.736484 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: from cryptography.utils import int_from_bytes Jul 07 15:24:27.737006 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 15:24:27.737006 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: from cryptography.utils import int_from_bytes Jul 07 15:24:27.737424 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 15:24:27.737424 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: from cryptography.utils import int_from_bytes Jul 07 15:24:30.200151 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 15:24:30.200705 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 15:24:30.200920 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 15:24:30.201278 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 15:24:30.201532 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 15:24:30.201917 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.202241 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.203163 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.203163 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.203163 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.203489 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.203833 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.204162 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.204479 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.205324 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.205627 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.205952 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-5-iscsi {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.206274 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.206579 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.206670 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 15:24:30.207033 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.207121 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 15:24:30.207205 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.207392 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 15:24:30.207484 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.207800 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 15:24:30.207900 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.208055 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 15:24:30.208140 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.208439 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.208582 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.208760 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.209023 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.209158 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.209329 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.209441 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.209638 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.209740 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.209973 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.210083 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.210285 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.210389 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.210590 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.210684 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.210906 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.211020 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.211227 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.211365 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.211479 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.211611 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.211824 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-5-iscsi {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.211919 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.212146 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.212236 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-5-iscsi {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.212450 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.212552 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.212757 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.212867 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.213072 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.213165 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.213374 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.213526 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.213694 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.213836 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.214040 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.214146 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.214446 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.214543 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.214776 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.214876 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.215075 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.215161 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.215382 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.215474 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.215722 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.215823 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.216037 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.216122 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.216346 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.216448 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.216641 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.216735 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.216946 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.217046 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.217252 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.217340 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.217562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.217655 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.217862 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.218003 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-5-iscsi {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.218166 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.218260 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.218415 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.218547 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.218720 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.218858 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.219041 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.219263 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.219356 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.219589 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.219691 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.219906 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.220002 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.220190 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.220285 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.220561 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.220653 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.220868 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.220962 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.221173 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.221335 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.221481 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.221575 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.221785 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.221877 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.222091 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.222179 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.222388 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.222523 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.222691 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.222780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.222994 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.223088 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.223294 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.223385 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.223618 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.223720 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.223925 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.224028 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.224175 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.224263 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.224483 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.224588 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.224801 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.224889 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.225119 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.225213 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.225439 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.225543 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.225689 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.225799 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.225960 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.226058 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.226248 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.226347 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.226567 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.226656 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.226876 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.226964 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.227184 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.227271 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.227495 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.227620 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.227829 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.227917 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.228136 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.228229 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.228441 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.228527 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.228749 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.228843 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.229056 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.229150 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.229302 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.229388 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.229602 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.229699 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.229906 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.230000 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.230220 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.230307 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.230524 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.230619 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.230827 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.230947 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.231128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.231256 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.231425 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.231527 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.231753 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.231848 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.232058 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.232147 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.232363 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.232461 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.232670 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.233010 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.233229 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.233316 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.233529 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.233626 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.233831 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.233918 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.234134 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.234221 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.234434 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.234546 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.234750 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.234857 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.235064 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.235152 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.235315 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.235401 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.235641 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.235733 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.236463 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.236560 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.236782 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.236879 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.237089 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.237176 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.237389 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.237474 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.237692 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.237777 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.238000 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.238086 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.238298 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.238390 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.238599 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.238696 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.238901 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.238986 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.239204 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.239296 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.239504 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.239617 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.239833 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.239928 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.240129 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.240215 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.240429 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.240517 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.240732 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.240826 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.241032 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.241126 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.241338 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.241465 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.241640 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.241738 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.241939 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.242044 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.242234 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.242340 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.242536 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.242630 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.242829 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.243002 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.243137 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.243240 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.243432 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.243521 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.243771 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.243868 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.244074 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.244167 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.244377 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.244464 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.244678 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.244785 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.244981 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.245080 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.245278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.245374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.245595 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.245692 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.245894 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.245987 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.246197 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.246317 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.246510 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.246632 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.246814 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.246963 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.247116 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.247293 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.247417 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.247634 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.247726 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.247950 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.248045 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.248263 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.248359 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.248586 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.248674 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.248895 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.248981 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.249192 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.249280 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.249497 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.249584 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.249811 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.249904 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.250117 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.250212 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.250421 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.250509 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.250723 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.250815 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.251038 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:24:30.251126 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.251351 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.252136 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.252229 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.252310 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.252551 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.252640 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.252880 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.252965 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.253201 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.253296 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.253514 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.253621 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.253831 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.253920 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.254145 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.254234 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.254459 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.254555 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.254784 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.254872 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.255099 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.255208 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.255407 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.255495 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.255738 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.255838 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.256047 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.256147 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.256360 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.256447 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.256686 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.256773 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.256995 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.257095 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.257306 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.257393 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.257614 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.257707 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.257926 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.258022 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.258237 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.258334 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.258548 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.258636 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.258861 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.258958 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.259167 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.259254 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.259493 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.259629 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.259835 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.259924 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.260146 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.260240 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.260462 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.260550 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.260773 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.260862 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.261081 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.261174 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.261386 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.261480 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.261689 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.261785 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.261989 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.262075 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.262294 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.262379 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.262584 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.262673 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.262892 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.262988 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.263210 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.263307 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.263518 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.263625 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.263852 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.263940 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.264181 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.264281 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.264485 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.264573 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.264793 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.264889 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.265107 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.265234 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.265413 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.265520 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.265716 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.265821 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.266023 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.266199 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.266329 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.266430 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.266629 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.266724 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.266932 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.267091 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.267263 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.267350 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.267584 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.267687 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.267896 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.267984 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.268202 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.268298 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.268503 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.268592 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.268815 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.268910 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.269125 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.269224 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.269423 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.269510 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.269734 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.269831 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.270039 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.270125 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.270346 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.270443 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.270652 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.270739 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.270957 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.271058 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.271254 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.271354 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.271576 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.271712 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.271890 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.271979 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.272192 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.272417 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.272510 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.272591 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.272801 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.272889 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.273104 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.273201 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.273424 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.273512 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.273725 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.273811 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.274023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.274111 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.274324 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.274410 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.274626 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.274721 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.274925 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.275012 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.275233 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.275348 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.275533 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.275647 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.275872 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.275967 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.276172 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.276257 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.276479 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.276572 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.276786 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.276872 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.277088 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.277174 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.277390 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.277483 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.277690 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.277786 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.278030 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.278126 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.278336 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.278431 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.278634 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.278718 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.278942 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.279026 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.279244 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.279342 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.279548 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.279661 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.279869 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.279966 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.280174 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.280277 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.280474 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.280561 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.280774 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.280860 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.281076 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.281169 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.281375 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.281461 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.281742 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.281839 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.281997 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.282083 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.282305 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.282389 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.282599 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.282701 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.282922 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.283009 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.283226 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.283318 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.283551 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.283672 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.283883 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.283969 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.284193 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.284280 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.284534 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.284621 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.284850 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.284935 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.285168 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.285254 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.285478 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.285581 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.285785 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.285879 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.286093 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.286187 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.286397 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.286499 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.286704 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.286804 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.287009 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.287109 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.287317 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.287420 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.287645 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.287751 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.287955 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.288057 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.288269 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.288372 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.288573 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.288667 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.288888 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.288982 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.289193 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.289287 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.289497 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.289589 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.289797 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.289890 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.290109 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.290205 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.290433 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.290528 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.290749 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.290842 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.291058 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.291159 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.291364 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.291467 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.291698 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.291823 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.292007 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.292109 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.292312 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.292405 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.292616 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.292723 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.292922 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.293016 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.293225 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.293325 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.293532 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.293634 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.293841 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.293937 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.294145 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.294239 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.294450 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.294627 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.294756 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.294872 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.295067 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.295156 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.295367 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.295480 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.295693 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.295789 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.295995 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.296082 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.296304 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.296405 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.296623 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.296712 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.296932 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.297018 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.297249 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.297336 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.297555 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.297641 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.297859 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.297945 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.298163 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.298816 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.298996 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.299090 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.299304 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.299391 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.299631 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.299735 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.299938 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.300026 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.300241 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.300328 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.300547 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.300641 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.300849 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.300983 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.301162 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.301260 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.301470 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.301557 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.301773 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.301869 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.302077 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.302176 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.302388 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.302475 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.302702 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.302821 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.303008 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.303113 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.303327 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.303423 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.303665 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.303761 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.303969 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.304080 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.304272 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.304376 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.304581 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.304675 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.304886 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.304980 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.305190 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.305284 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.305493 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.305625 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.305795 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.305889 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.306108 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.306200 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.306408 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.306493 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.306711 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.306805 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.307020 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.307112 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.307333 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.307417 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.307661 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.307923 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.308009 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.308251 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.308337 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.308565 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.308652 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.308880 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.308972 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.309192 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.309277 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.309498 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.309585 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.309807 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.309892 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.310117 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.310201 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.310425 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.310518 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.310734 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.310832 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.311042 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.311134 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.311347 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.311443 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.311674 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.311764 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.311982 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.312120 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.312284 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.312382 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.312591 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.312727 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.312893 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.312988 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.313201 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.313451 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.313539 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.313785 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.313872 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.314641 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.314739 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.314949 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.315035 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.315264 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.315351 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.315591 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.315730 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.315904 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.315990 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.316208 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.316300 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.316528 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.316630 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.316835 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.316930 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.317137 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.317222 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.317438 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.317524 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.317740 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.317837 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.318053 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.318141 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.318365 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.318461 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.318667 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.318754 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.318972 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.319059 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.319282 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.319443 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.319604 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.319707 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.319911 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.319997 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.320215 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.320308 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.320518 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.320610 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.320823 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.320909 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.321120 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.321213 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.321425 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.321510 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.321724 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.321817 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.322022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.322116 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.322329 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.322417 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.322627 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.322711 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.322929 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.323018 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.323230 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.323318 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.323533 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.323643 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.323864 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.323951 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.324168 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.324254 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.324481 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.324575 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.324789 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.324882 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.325091 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.325177 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.325394 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.325479 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.325703 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.325825 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.326010 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.326108 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.326308 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.326402 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.326611 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.326697 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.326907 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.326992 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.327209 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.327302 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.327509 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.327632 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.327837 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.327920 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.328140 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.328235 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.328448 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.328542 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.328753 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.328837 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.329051 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.329143 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.329354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.329446 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.329682 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.329776 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.329991 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.330084 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.330295 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.330379 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.330594 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.330681 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.330893 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.330988 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.331195 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.331280 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.331496 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.331601 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.331838 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.331926 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.332147 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.332238 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.332446 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.332550 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.332753 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.332841 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.333052 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.333144 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.333351 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.333444 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.333646 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.333738 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.333950 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.334034 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.334251 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.334350 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.334547 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.334639 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.334846 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.334932 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.335150 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.335243 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.335447 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.335531 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.335773 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.335869 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.336081 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.336182 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.336379 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.336476 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.336677 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.336768 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.336975 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.337067 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.337291 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.337376 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.337603 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.337687 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.337901 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.337987 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.338206 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.338292 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.338514 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.338606 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.338817 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.338904 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.339119 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.339204 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.339426 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.339517 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.339764 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.339853 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.340068 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.340153 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.340364 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.340457 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.340664 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.340749 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.340963 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.341048 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.341264 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.341356 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.341567 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.341652 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.341864 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.341948 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.342167 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.342269 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.342468 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.342563 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.342781 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.342866 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.343095 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.343238 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.343420 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.343505 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.343751 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.343839 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.344063 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.344150 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.344372 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.344464 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.344678 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.344763 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.344983 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.345070 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.345345 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.345445 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.345652 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.345738 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.345967 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.346101 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.346276 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.346370 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.346585 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.346669 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.346887 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.346981 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.347189 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.347273 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.347498 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.347604 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.347834 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.347923 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.348139 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.348231 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.348462 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.348561 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.348771 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.348857 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.349074 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.349159 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.349380 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.349477 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.349681 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.349767 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.349989 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.350074 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.350289 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.350382 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.350596 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.350710 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.350904 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.351022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.351215 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.351331 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.351525 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.351664 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.351861 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.351947 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.352174 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.352269 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.352486 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.352578 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.352792 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.352878 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.353101 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.353188 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.353409 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.353543 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.353711 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.353854 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.354034 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.354164 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.354343 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.354472 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.354646 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.354775 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.354955 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.355076 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.355261 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.355383 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.355587 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.355747 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.355896 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.356051 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.356324 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.356420 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.356638 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.356732 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.356952 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.357044 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.357252 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.357337 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.357560 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.357652 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.358125 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.358213 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.358449 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.358534 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.358764 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.358862 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.359069 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.359204 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.359482 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.359618 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.359822 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.359911 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.360135 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.360220 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.360446 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.360531 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.361275 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.361369 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.361587 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.361680 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.361897 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.361982 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.362207 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.362294 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.362508 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.362635 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.362813 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.362899 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.363116 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.363239 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.363430 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.363515 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.363757 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.363860 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.364079 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.364165 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.364397 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.364502 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.364707 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.364794 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.365026 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.365120 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.365438 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.365531 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.365764 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.365863 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.366071 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.366165 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.366388 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.366482 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.366704 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.366789 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.367005 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.367099 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.367308 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.367401 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.367641 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.367743 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.367947 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.368046 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.368252 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.368338 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.368572 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.368664 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.368874 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.368961 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.369182 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.369276 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.369482 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.369568 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.369786 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.369871 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.370088 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.370173 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.370391 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.370477 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.370711 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.370799 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.371014 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.371121 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.371333 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.371427 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.371669 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.371779 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.371994 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.372102 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.372313 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.372420 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.372618 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.372748 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.372939 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.373033 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.373246 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.373377 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.373549 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.373636 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.373851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.373937 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.374158 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.374254 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.374468 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.374554 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.374778 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.374872 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.375090 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.375177 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.375398 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.375485 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.375724 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.375825 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.376030 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.376118 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.376364 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.377033 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.377204 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.377291 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.377528 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.377616 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.377844 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.377930 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.378161 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.378255 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.378461 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.378548 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.378766 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.378852 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.379076 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.379170 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.379380 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.379466 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.379704 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.379805 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.380011 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.380107 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.380315 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.380402 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.380613 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.380706 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.380916 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.381011 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.381217 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.381313 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.381535 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.381629 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.381838 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.381932 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.382158 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.382244 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.382467 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.382589 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.382769 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.382877 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.383071 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.383168 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.383375 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.383516 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.383735 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.383874 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.384041 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.384175 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.384345 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.384475 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.384654 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.384791 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.384959 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.385097 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.385264 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.385403 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.385557 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.385697 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.385860 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.386004 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.386162 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.386302 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.386465 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.386598 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.386769 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.386856 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.387076 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.387170 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.387377 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.387463 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.387715 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.387806 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.388022 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.388156 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.388326 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.388411 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.388626 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.388710 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.388934 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.389028 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.389246 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.389331 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.389563 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.389762 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.389895 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.390091 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.390211 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.390406 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.390530 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.390720 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.390856 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.391033 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.391162 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.391346 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.391481 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.391698 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.391821 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.392049 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.392163 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.392365 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.392480 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.392676 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.392795 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.392990 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.393096 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.393314 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.393400 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.393636 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.393740 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.393966 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.394055 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.394298 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.394391 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.394610 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.394698 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.394922 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.395007 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.395233 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.395440 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.395659 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.395794 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.395909 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.396109 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.396223 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.396422 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.396516 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.396734 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.396829 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.397046 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.397132 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.397358 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.397452 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.397668 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.397755 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.397975 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.398061 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.398284 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.398371 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.398591 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.398677 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.398899 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.398992 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.399207 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.399294 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.399518 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.399623 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.399867 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.399967 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.400179 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.400265 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.400493 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.400579 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.400809 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.400908 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.401117 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.401203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.401429 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.401515 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.401741 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.401828 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.402056 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.402256 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.402371 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.402570 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.402727 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.402901 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.403013 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.403224 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.403313 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.403543 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.403697 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.403883 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.403969 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.404198 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.404283 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.404504 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.404590 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.404812 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.404908 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.405117 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.405219 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.405423 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.405511 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.405728 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.405818 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.406032 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.406139 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.406349 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.406443 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.406654 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.406777 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.406954 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.407053 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.407266 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.407352 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.407617 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.407832 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.408138 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.408242 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.408467 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.408552 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.408778 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.408871 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.409102 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.409196 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.409414 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.409500 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.409727 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.409818 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.410033 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.410120 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.410341 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.410434 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.410641 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.410726 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.410943 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.411030 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.411247 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.411339 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.411550 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.411653 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.411878 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.411966 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.412179 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.412275 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.412481 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.412574 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.412785 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.412878 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.413087 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.413211 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.413393 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.413618 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.413713 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.413967 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.414102 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.414286 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.414382 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.414591 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.414677 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.414893 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.414978 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.415201 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.415286 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.415504 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.415611 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.415845 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.415932 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.416149 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.416236 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.416452 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.416539 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.416759 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.416880 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.417060 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.417155 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.417361 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.417455 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.417662 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.417747 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.417970 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.418063 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.418273 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.418367 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.418573 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.418658 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.418889 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.418983 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.419194 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.419279 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.419519 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.419649 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.419847 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.419941 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.420151 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.420238 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.420454 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.420540 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.420766 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.420862 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.421069 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.421154 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.421371 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.421458 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.421676 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.421799 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.421977 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.422066 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.422286 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.422522 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.422617 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.422859 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.422946 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.423168 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.423797 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.424027 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.424180 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.424331 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.424418 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.424638 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.424726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.424981 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.425067 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.425291 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.425377 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.425593 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.425679 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.425901 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.426001 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.426209 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.426303 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.426516 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.426601 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.426825 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.426911 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.427135 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.427229 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.427441 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.427527 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.427777 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.427867 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.428087 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.428174 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.428395 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.428620 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.428717 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.428953 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.429041 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.429280 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.429366 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.429583 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.429669 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.429897 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.429989 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.430220 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.430312 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.430524 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.430619 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.430827 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.430914 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.431141 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.431244 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.431455 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.431604 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.431791 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.431908 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.432102 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.432289 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.432407 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.432496 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.432715 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.432814 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.433020 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.433120 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.433327 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.433417 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.433636 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.433732 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.433941 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.434044 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.434243 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.434358 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.434551 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.434672 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.434859 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.434990 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.435164 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.435310 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.435475 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.435641 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.435840 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.435965 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.436160 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.436287 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.436477 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.436598 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.436792 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.436918 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.437110 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.437228 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.437416 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.437558 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.437725 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.437896 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.438033 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.438225 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.438341 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.438548 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.438644 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.438873 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.439521 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.439733 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.439843 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.440042 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.440151 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.440351 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.440568 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.440654 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.440883 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.440971 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.441201 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.441287 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.441521 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.441615 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.441829 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.441916 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.442131 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.442263 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.442434 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.442521 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.442736 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.442824 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.443039 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.443125 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.443345 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.443439 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.443670 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.443760 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.443973 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.444096 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.444274 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.444377 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.444582 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.444668 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.444883 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.444976 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.445184 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.445278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.445489 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.445575 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.445788 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.445873 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.446088 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.446185 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.446386 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.446472 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.446682 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.446773 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.446980 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.447066 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.447284 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.447372 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.447603 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.447692 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.447909 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.448005 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.448210 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.448303 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.448509 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.448595 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.448812 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.448899 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.449111 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.449198 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.449412 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.449505 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.449718 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.449805 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.450017 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.450109 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.450317 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.450411 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.450617 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.450710 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.450920 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.451014 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.451221 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.451317 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.451522 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.451638 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.451846 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.451940 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.452146 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.452240 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.452446 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.452542 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.452766 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.452851 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.453093 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.453196 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.453400 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.453492 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.453720 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.453805 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.454025 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.454111 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.454342 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.454436 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.454674 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.454752 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.454987 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.455079 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.455298 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.455373 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.455373 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.461670 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.461768 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.461851 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.461930 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462009 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462087 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462175 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462255 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462341 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462410 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462519 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462642 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462740 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462740 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462910 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.462987 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463064 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463145 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463234 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463322 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463405 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463485 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463582 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463679 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463763 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463843 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.463931 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464013 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464138 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464239 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464312 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464379 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464459 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464539 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464620 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464781 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464867 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.464947 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465028 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 15:24:30.465108 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465108 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465108 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465108 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465108 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465108 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465108 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465108 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465688 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465688 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465688 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.465688 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.466153 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.466723 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.467276 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.467855 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.468387 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:24:30.468779 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 15:24:30.523995 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO dbcounter [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Registered counter for database nova_api Jul 07 15:24:30.530609 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO dbcounter [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Registered counter for database nova_api Jul 07 15:24:30.636995 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_db.sqlalchemy.engines [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:24:30.642063 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG oslo_db.sqlalchemy.engines [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:24:30.643498 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writer thread running {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:24:30.648371 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writer thread running {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:24:30.698560 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.context [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316eb91c-3dad-4e42-84e1-39a08b9618c9(cell1) {{(pid=103550) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 15:24:30.702502 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:24:30.703665 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.context [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316eb91c-3dad-4e42-84e1-39a08b9618c9(cell1) {{(pid=103549) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 15:24:30.704098 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:24:30.704938 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:24:30.707004 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:24:30.707591 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG oslo_concurrency.lockutils [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:24:30.708967 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO dbcounter [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Registered counter for database nova_cell0 Jul 07 15:24:30.709131 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG oslo_concurrency.lockutils [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:24:30.709937 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG oslo_concurrency.lockutils [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:24:30.712023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG oslo_concurrency.lockutils [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:24:30.712835 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO dbcounter [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Registered counter for database nova_cell1 Jul 07 15:24:30.713957 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO dbcounter [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Registered counter for database nova_cell0 Jul 07 15:24:30.717814 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO dbcounter [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Registered counter for database nova_cell1 Jul 07 15:24:30.720968 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_db.sqlalchemy.engines [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:24:30.723174 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_db.sqlalchemy.engines [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:24:30.725860 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG oslo_db.sqlalchemy.engines [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:24:30.727324 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG oslo_db.sqlalchemy.engines [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:24:30.728206 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writer thread running {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:24:30.730772 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writer thread running {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:24:30.733511 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writer thread running {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:24:30.735534 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writer thread running {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:24:30.874986 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO dbcounter [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Registered counter for database nova_cell0 Jul 07 15:24:30.880279 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO dbcounter [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Registered counter for database nova_cell0 Jul 07 15:24:30.883686 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_db.sqlalchemy.engines [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:24:30.887995 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writer thread running {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:24:30.888627 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG oslo_db.sqlalchemy.engines [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:24:30.892882 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writer thread running {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:24:31.310421 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: WARNING keystonemiddleware.auth_token [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 15:24:31.318231 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: WARNING keystonemiddleware.auth_token [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 15:24:31.408700 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: WARNING keystonemiddleware.auth_token [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 15:24:31.416063 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: WARNING keystonemiddleware.auth_token [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 15:24:31.657245 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: WARNING keystonemiddleware.auth_token [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 15:24:31.664069 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: WARNING keystonemiddleware.auth_token [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 15:24:31.669473 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c2d7a99c0 pid: 103550 (default app) Jul 07 15:24:31.671826 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:24:31.673045 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001994 Jul 07 15:24:31.674097 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Thu Jul 7 15:24:31 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:24:31.753003 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: WARNING keystonemiddleware.auth_token [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 15:24:31.758910 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: WARNING keystonemiddleware.auth_token [None req-fb1bf3f0-2baf-4149-a634-6a59868219b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 15:24:31.764133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c2d7a99c0 pid: 103549 (default app) Jul 07 15:25:48.951632 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:25:48.953424 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002222 Jul 07 15:25:48.954654 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:25:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:25:48.968899 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writing DB stats nova_api:SELECT=3 {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:25:48.970014 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writing DB stats nova_cell0:SELECT=3 {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:25:48.971005 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writing DB stats nova_cell1:SELECT=3 {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:25:48.972123 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:25:49.403867 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-65910ef7-7a56-463b-8326-e8b4c6ef111b admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:25:49.434056 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-65910ef7-7a56-463b-8326-e8b4c6ef111b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.472208 Jul 07 15:25:49.438578 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Thu Jul 7 15:25:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:25:51.500467 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:25:51.501466 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-559ad1b8-b8b6-425b-b589-9310eca4f9f1 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 07 15:25:51.501856 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:25:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:25:51.562658 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-4fa12f79-2688-417a-9cd7-4308853faa9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "swap": 0, "vcpus": 1}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:25:51.580746 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 15:25:51.580746 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: warnings.warn(msg) Jul 07 15:25:51.666859 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-4fa12f79-2688-417a-9cd7-4308853faa9f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.159226 Jul 07 15:25:51.667479 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:25:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:25:51.681894 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_api:SELECT=3 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:25:51.683519 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_cell0:SELECT=3 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:25:51.684285 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_cell1:SELECT=3 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:25:51.685009 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:25:51.888991 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-c055d0da-9e67-4798-b0ab-1535ffc97b27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:25:51.891418 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 15:25:51.891418 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: warnings.warn(msg) Jul 07 15:25:52.007605 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-c055d0da-9e67-4798-b0ab-1535ffc97b27 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331156 Jul 07 15:25:52.023917 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Thu Jul 7 15:25:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:25:54.111983 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-4fa12f79-2688-417a-9cd7-4308853faa9f admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:25:54.112994 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-4fa12f79-2688-417a-9cd7-4308853faa9f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 07 15:25:54.113394 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:25:54.219935 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-b11fb0c1-d4ca-4fd9-bc7f-4c5ec3830eee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:25:54.242792 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 15:25:54.242792 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: warnings.warn(msg) Jul 07 15:25:54.320396 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-b11fb0c1-d4ca-4fd9-bc7f-4c5ec3830eee admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.201108 Jul 07 15:25:54.320871 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:25:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:25:54.333407 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-bccabcae-1a53-45d0-bb70-f62c923624dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:25:54.334903 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 15:25:54.334903 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: warnings.warn(msg) Jul 07 15:25:54.436252 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-bccabcae-1a53-45d0-bb70-f62c923624dd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106413 Jul 07 15:25:54.443254 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Thu Jul 7 15:25:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:25:56.512402 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-b11fb0c1-d4ca-4fd9-bc7f-4c5ec3830eee admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:25:56.513426 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-b11fb0c1-d4ca-4fd9-bc7f-4c5ec3830eee admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 07 15:25:56.513855 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:25:56.574896 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-0fe67f9e-8ea9-4e4a-a878-d5089e8431f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:25:56.634933 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-0fe67f9e-8ea9-4e4a-a878-d5089e8431f4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.114905 Jul 07 15:25:56.635960 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:25:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 15:25:56.647805 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-7e877370-6c3b-4042-b2ac-269361097e04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:25:56.736691 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-7e877370-6c3b-4042-b2ac-269361097e04 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092565 Jul 07 15:25:56.737291 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Thu Jul 7 15:25:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:25:58.840659 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-0fe67f9e-8ea9-4e4a-a878-d5089e8431f4 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:25:58.841681 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-0fe67f9e-8ea9-4e4a-a878-d5089e8431f4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 07 15:25:58.842091 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:25:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:25:58.900510 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-5dcbc3ba-4a59-436a-81a5-6138d24e0e34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d3"}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:25:58.971197 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-5dcbc3ba-4a59-436a-81a5-6138d24e0e34 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.122766 Jul 07 15:25:58.971848 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:25:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:25:58.984441 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-bce58187-ca9d-43fa-aa30-a8461262bc07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:25:59.163623 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-bce58187-ca9d-43fa-aa30-a8461262bc07 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.183613 Jul 07 15:25:59.164258 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Thu Jul 7 15:25:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:26:01.292938 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-5dcbc3ba-4a59-436a-81a5-6138d24e0e34 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:01.295443 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-5dcbc3ba-4a59-436a-81a5-6138d24e0e34 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002954 Jul 07 15:26:01.296985 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:01.356377 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-446469a1-43dd-4377-979d-f37baaa734a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "disk": 20, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:01.422348 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-446469a1-43dd-4377-979d-f37baaa734a1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.119400 Jul 07 15:26:01.423289 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:26:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:26:01.435136 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-fbe96e38-5e6c-44b5-8b5b-ebc4b35bb65a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:01.489772 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-fbe96e38-5e6c-44b5-8b5b-ebc4b35bb65a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058462 Jul 07 15:26:01.490521 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Thu Jul 7 15:26:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:26:03.605268 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-446469a1-43dd-4377-979d-f37baaa734a1 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:03.606438 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-446469a1-43dd-4377-979d-f37baaa734a1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jul 07 15:26:03.606876 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:03.672100 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-630cf3a1-fb03-4d41-8c21-37b731fea2bb admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:03.691165 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-630cf3a1-fb03-4d41-8c21-37b731fea2bb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077685 Jul 07 15:26:03.691942 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Thu Jul 7 15:26:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:26:05.859395 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-446469a1-43dd-4377-979d-f37baaa734a1 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:05.860434 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-446469a1-43dd-4377-979d-f37baaa734a1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 07 15:26:05.860826 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:26:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:05.923042 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-1a508305-2f6c-4127-98dd-b68f641951d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:06.117281 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-1a508305-2f6c-4127-98dd-b68f641951d6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.250273 Jul 07 15:26:06.118002 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:26:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:26:06.132581 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-f0dc98d8-a36b-4e82-a141-186ad36b7e11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:06.204992 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-f0dc98d8-a36b-4e82-a141-186ad36b7e11 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075886 Jul 07 15:26:06.205846 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Thu Jul 7 15:26:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:26:08.552921 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-1a508305-2f6c-4127-98dd-b68f641951d6 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:08.553936 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-1a508305-2f6c-4127-98dd-b68f641951d6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 07 15:26:08.554354 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:26:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:08.628083 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-d9efbabd-53ac-4fe0-a535-bdd4cc1af110 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "name": "m1.small"}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:08.696852 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-d9efbabd-53ac-4fe0-a535-bdd4cc1af110 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.136471 Jul 07 15:26:08.697412 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:26:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:26:08.709455 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-19bec255-5897-44e0-b484-a3e8623f8532 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:08.788637 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-19bec255-5897-44e0-b484-a3e8623f8532 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082722 Jul 07 15:26:08.789426 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Thu Jul 7 15:26:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:26:10.976792 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-d9efbabd-53ac-4fe0-a535-bdd4cc1af110 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:10.984016 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-d9efbabd-53ac-4fe0-a535-bdd4cc1af110 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 07 15:26:10.984016 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:11.038523 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-fe487346-9969-491f-bc1e-8afc296990ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:11.108297 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-fe487346-9969-491f-bc1e-8afc296990ef admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.123278 Jul 07 15:26:11.108996 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:26:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:26:11.120911 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-a2a4c7e7-6f81-4310-8014-505bcafc1d91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:11.208848 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-a2a4c7e7-6f81-4310-8014-505bcafc1d91 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091530 Jul 07 15:26:11.209445 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Thu Jul 7 15:26:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:26:13.258278 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-fe487346-9969-491f-bc1e-8afc296990ef admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:13.259541 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-fe487346-9969-491f-bc1e-8afc296990ef admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jul 07 15:26:13.260084 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:26:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:13.318628 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-9add83ef-c405-49d8-9f02-913047528e8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "id": "4"}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:13.393865 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-9add83ef-c405-49d8-9f02-913047528e8f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.127550 Jul 07 15:26:13.394429 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:26:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 15:26:13.406911 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-bedf89c4-d234-4c56-9495-e80219bd6cee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:13.512041 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-bedf89c4-d234-4c56-9495-e80219bd6cee admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109314 Jul 07 15:26:13.512549 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Thu Jul 7 15:26:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:26:15.589055 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-9add83ef-c405-49d8-9f02-913047528e8f admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:15.590064 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-9add83ef-c405-49d8-9f02-913047528e8f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 07 15:26:15.590773 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:15.655382 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-9f8f8af7-a997-40d6-94bf-30288fba5e59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "disk": 160}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:15.737290 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-9f8f8af7-a997-40d6-94bf-30288fba5e59 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.140099 Jul 07 15:26:15.738566 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Thu Jul 7 15:26:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:26:15.750315 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-63063a1b-dd99-40f9-9e4f-238768ce7f17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:15.843206 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-63063a1b-dd99-40f9-9e4f-238768ce7f17 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096432 Jul 07 15:26:15.855857 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Thu Jul 7 15:26:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:26:40.784942 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-9f8f8af7-a997-40d6-94bf-30288fba5e59 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:40.785955 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-9f8f8af7-a997-40d6-94bf-30288fba5e59 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 07 15:26:40.786359 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:26:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:40.793308 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:26:40.849660 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-d09b557b-f60a-4dae-b588-bf2ba1355389 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:40.866526 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-d09b557b-f60a-4dae-b588-bf2ba1355389 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074163 Jul 07 15:26:40.867053 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Thu Jul 7 15:26:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:26:41.777053 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-9f8f8af7-a997-40d6-94bf-30288fba5e59 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:41.778077 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-9f8f8af7-a997-40d6-94bf-30288fba5e59 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 07 15:26:41.778469 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:26:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:41.966031 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-c972a6bf-0100-42ac-8abd-10aa69b8d78a admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:41.971729 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.wsgi [None req-c972a6bf-0100-42ac-8abd-10aa69b8d78a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-c972a6bf-0100-42ac-8abd-10aa69b8d78a admin admin] Request method failure captured: Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Accept: application/json Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Accept-Encoding: gzip, deflate Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Connection: keep-alive Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Content-Length: 0 Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Host: 10.222.0.25 Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Openstack-Api-Version: compute 2.90 Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Openstack-System-Scope: None Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: User-Agent: python-novaclient Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Auth-Token: gAAAAABixvsxOj9v3loBVP6RWf1k16lQJvNzNmzXI17876Krm7IZ1nr08T2YgF02KsN2nHdlJX83tv1d9yu5ENT3O3zKE5r6YR7C18o8ToS0mt1_edfKUq5jJQ_6u1BwaANiBmyXXlQI3cVojPaQ0eJBWIrf3dpOE39lrMGOVVcta1gZ1hukIHI Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Domain-Id: None Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Domain-Name: None Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Identity-Status: Confirmed Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Is-Admin-Project: True Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Domain-Id: default Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Domain-Name: Default Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Name: admin Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Role: member,reader,admin Jul 07 15:26:41.974956 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Roles: member,reader,admin Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28133f9a98be4af88ed357f76f5a4a2e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Tenant: admin Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Tenant-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Tenant-Name: admin Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User: admin Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Domain-Id: default Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Domain-Name: Default Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Id: 30014035e7d641d5aecffdbe884d3d52 Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Name: admin Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: method: > Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: exception: Flavor 42 could not be found. Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: action_args: {'id': '42'} Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:26:41.976562 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:41.977580 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:41.979133 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-c972a6bf-0100-42ac-8abd-10aa69b8d78a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:26:41.980417 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-c972a6bf-0100-42ac-8abd-10aa69b8d78a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062568 Jul 07 15:26:41.980417 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Jul 7 15:26:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 15:26:41.986228 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-0df50bc6-d921-4bb7-b3d5-72fb0a36ef13 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:41.989272 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:26:42.007744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-0df50bc6-d921-4bb7-b3d5-72fb0a36ef13 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025282 Jul 07 15:26:42.008277 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Jul 7 15:26:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:26:42.018499 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-70886ea0-1bf6-42fe-a055-1b6228492347 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:42.040176 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-70886ea0-1bf6-42fe-a055-1b6228492347 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025468 Jul 07 15:26:42.040695 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Jul 7 15:26:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:26:42.050018 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-2d0d6c1e-e23e-4345-82e0-62a22e74725a admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:42.055947 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.wsgi [None req-2d0d6c1e-e23e-4345-82e0-62a22e74725a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-2d0d6c1e-e23e-4345-82e0-62a22e74725a admin admin] Request method failure captured: Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Accept: application/json Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Accept-Encoding: gzip, deflate Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Connection: keep-alive Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Content-Length: 0 Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Host: 10.222.0.25 Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Openstack-Api-Version: compute 2.90 Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Openstack-System-Scope: None Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: User-Agent: python-novaclient Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Auth-Token: gAAAAABixvsxOj9v3loBVP6RWf1k16lQJvNzNmzXI17876Krm7IZ1nr08T2YgF02KsN2nHdlJX83tv1d9yu5ENT3O3zKE5r6YR7C18o8ToS0mt1_edfKUq5jJQ_6u1BwaANiBmyXXlQI3cVojPaQ0eJBWIrf3dpOE39lrMGOVVcta1gZ1hukIHI Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Domain-Id: None Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Domain-Name: None Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Identity-Status: Confirmed Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Is-Admin-Project: True Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Domain-Id: default Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Domain-Name: Default Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Name: admin Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Role: member,reader,admin Jul 07 15:26:42.059305 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Roles: member,reader,admin Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28133f9a98be4af88ed357f76f5a4a2e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Tenant: admin Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Tenant-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Tenant-Name: admin Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User: admin Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Domain-Id: default Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Domain-Name: Default Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Id: 30014035e7d641d5aecffdbe884d3d52 Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Name: admin Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: method: > Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: exception: Flavor 42 could not be found. Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: action_args: {'id': '42'} Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:26:42.060882 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:42.061744 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:42.062851 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-2d0d6c1e-e23e-4345-82e0-62a22e74725a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:26:42.069623 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-2d0d6c1e-e23e-4345-82e0-62a22e74725a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014181 Jul 07 15:26:42.069623 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Jul 7 15:26:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 15:26:42.874254 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-70886ea0-1bf6-42fe-a055-1b6228492347 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:42.875240 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-70886ea0-1bf6-42fe-a055-1b6228492347 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 07 15:26:42.875649 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:26:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:43.063447 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-cd516639-516e-4ccd-80f2-25fb9c7432d0 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:43.069308 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.wsgi [None req-cd516639-516e-4ccd-80f2-25fb9c7432d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-cd516639-516e-4ccd-80f2-25fb9c7432d0 admin admin] Request method failure captured: Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Accept: application/json Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Accept-Encoding: gzip, deflate Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Connection: keep-alive Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Content-Length: 0 Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Host: 10.222.0.25 Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Openstack-Api-Version: compute 2.90 Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Openstack-System-Scope: None Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: User-Agent: python-novaclient Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Auth-Token: gAAAAABixvsy3GIHEO_7W5HCLzlQDVxfDruHEv8y4evEBw8jHbuVGkAYuC4dauY-vLWGUt1ulY1_-PJ4wRgrKAlk49r6gklXmlVEBfNR3WeA9sQJnUq2O77vQon2hXaYJDTNr_Gjzr-MqQDaqgpinFg7pD6CCB5WpYHaPo4bPcAhuaJDyt1Fetc Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Domain-Id: None Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Domain-Name: None Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Identity-Status: Confirmed Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Is-Admin-Project: True Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Domain-Id: default Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Domain-Name: Default Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Name: admin Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Role: member,reader,admin Jul 07 15:26:43.070813 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Roles: member,reader,admin Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28133f9a98be4af88ed357f76f5a4a2e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Tenant: admin Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Tenant-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Tenant-Name: admin Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User: admin Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Domain-Id: default Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Domain-Name: Default Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Id: 30014035e7d641d5aecffdbe884d3d52 Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Name: admin Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: method: > Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: exception: Flavor 84 could not be found. Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: action_args: {'id': '84'} Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:26:43.072374 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:43.076270 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.077726 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-cd516639-516e-4ccd-80f2-25fb9c7432d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:26:43.079046 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-cd516639-516e-4ccd-80f2-25fb9c7432d0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060755 Jul 07 15:26:43.079046 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Jul 7 15:26:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 15:26:43.082774 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-cc31a2a3-3c23-4932-a41c-4c1620265156 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:43.096371 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-cc31a2a3-3c23-4932-a41c-4c1620265156 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017468 Jul 07 15:26:43.096826 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Jul 7 15:26:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:26:43.106248 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-864e7614-3848-4b14-a046-3ee944d1e00b admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:43.119921 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-864e7614-3848-4b14-a046-3ee944d1e00b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017436 Jul 07 15:26:43.120464 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Jul 7 15:26:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:26:43.129604 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-23f593fe-8fea-47d3-9634-57195be890c1 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:43.134766 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.wsgi [None req-23f593fe-8fea-47d3-9634-57195be890c1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-23f593fe-8fea-47d3-9634-57195be890c1 admin admin] Request method failure captured: Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Accept: application/json Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Accept-Encoding: gzip, deflate Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Connection: keep-alive Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Content-Length: 0 Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Host: 10.222.0.25 Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Openstack-Api-Version: compute 2.90 Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Openstack-System-Scope: None Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: User-Agent: python-novaclient Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Auth-Token: gAAAAABixvsy3GIHEO_7W5HCLzlQDVxfDruHEv8y4evEBw8jHbuVGkAYuC4dauY-vLWGUt1ulY1_-PJ4wRgrKAlk49r6gklXmlVEBfNR3WeA9sQJnUq2O77vQon2hXaYJDTNr_Gjzr-MqQDaqgpinFg7pD6CCB5WpYHaPo4bPcAhuaJDyt1Fetc Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Domain-Id: None Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Domain-Name: None Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Identity-Status: Confirmed Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Is-Admin-Project: True Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Domain-Id: default Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Domain-Name: Default Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Name: admin Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Role: member,reader,admin Jul 07 15:26:43.136278 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Roles: member,reader,admin Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28133f9a98be4af88ed357f76f5a4a2e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Tenant: admin Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Tenant-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Tenant-Name: admin Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User: admin Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Domain-Id: default Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Domain-Name: Default Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Id: 30014035e7d641d5aecffdbe884d3d52 Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Name: admin Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: method: > Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: exception: Flavor 84 could not be found. Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: action_args: {'id': '84'} Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:26:43.138354 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:43.139203 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:43.140780 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-23f593fe-8fea-47d3-9634-57195be890c1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:26:43.142079 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-23f593fe-8fea-47d3-9634-57195be890c1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011328 Jul 07 15:26:43.142079 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Jul 7 15:26:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 15:26:43.964135 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-864e7614-3848-4b14-a046-3ee944d1e00b admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:43.965138 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-864e7614-3848-4b14-a046-3ee944d1e00b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 07 15:26:43.966841 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:26:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:44.158626 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-ba4adca6-8d68-4372-8fab-b72799a0d657 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:44.164056 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.wsgi [None req-ba4adca6-8d68-4372-8fab-b72799a0d657 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-ba4adca6-8d68-4372-8fab-b72799a0d657 admin admin] Request method failure captured: Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Accept: application/json Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Accept-Encoding: gzip, deflate Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Connection: keep-alive Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Content-Length: 0 Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Host: 10.222.0.25 Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Openstack-Api-Version: compute 2.90 Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Openstack-System-Scope: None Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: User-Agent: python-novaclient Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Auth-Token: gAAAAABixvsz3nrZ3uLxFzgj7ncXHk1zz0LlgLsoTM3tkh6vTm-UNrOB12dqjLINEu194XrvXBpz-6euW87DMCH7itgLLwroQkf2TXAmlEGDANSkLs0AoWPCWovbdJ1odoT6GnJPAPRZJwZR0bJmubBVOFP557gzbNB0cyBkzcHVyz01wH_Co4U Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Domain-Id: None Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Domain-Name: None Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Identity-Status: Confirmed Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Is-Admin-Project: True Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Domain-Id: default Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Domain-Name: Default Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Project-Name: admin Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Role: member,reader,admin Jul 07 15:26:44.165535 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Roles: member,reader,admin Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28133f9a98be4af88ed357f76f5a4a2e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Tenant: admin Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Tenant-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-Tenant-Name: admin Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User: admin Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Domain-Id: default Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Domain-Name: Default Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Id: 30014035e7d641d5aecffdbe884d3d52 Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: X-User-Name: admin Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: method: > Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: exception: Flavor 451 could not be found. Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: action_args: {'id': '451'} Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:26:44.167023 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:44.167892 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.169140 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-ba4adca6-8d68-4372-8fab-b72799a0d657 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:26:44.170372 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-ba4adca6-8d68-4372-8fab-b72799a0d657 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060503 Jul 07 15:26:44.170372 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Jul 7 15:26:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 15:26:44.176834 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-1a2d95d2-661a-47c0-bb28-cb9ed0ba8d35 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:44.190369 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-1a2d95d2-661a-47c0-bb28-cb9ed0ba8d35 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017285 Jul 07 15:26:44.190889 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Jul 7 15:26:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:26:44.201085 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:44.214488 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017797 Jul 07 15:26:44.215449 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Jul 7 15:26:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:26:44.225188 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-bebeb2cb-2edd-4c0c-820e-adcdad5e2e8d admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:44.230580 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.wsgi [None req-bebeb2cb-2edd-4c0c-820e-adcdad5e2e8d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-bebeb2cb-2edd-4c0c-820e-adcdad5e2e8d admin admin] Request method failure captured: Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Accept: application/json Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Accept-Encoding: gzip, deflate Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Connection: keep-alive Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Content-Length: 0 Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Host: 10.222.0.25 Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Openstack-Api-Version: compute 2.90 Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Openstack-System-Scope: None Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: User-Agent: python-novaclient Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Auth-Token: gAAAAABixvsz3nrZ3uLxFzgj7ncXHk1zz0LlgLsoTM3tkh6vTm-UNrOB12dqjLINEu194XrvXBpz-6euW87DMCH7itgLLwroQkf2TXAmlEGDANSkLs0AoWPCWovbdJ1odoT6GnJPAPRZJwZR0bJmubBVOFP557gzbNB0cyBkzcHVyz01wH_Co4U Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Domain-Id: None Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Domain-Name: None Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Identity-Status: Confirmed Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Is-Admin-Project: True Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Domain-Id: default Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Domain-Name: Default Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Project-Name: admin Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Role: member,reader,admin Jul 07 15:26:44.232095 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Roles: member,reader,admin Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28133f9a98be4af88ed357f76f5a4a2e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28133f9a98be4af88ed357f76f5a4a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Tenant: admin Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Tenant-Id: 28133f9a98be4af88ed357f76f5a4a2e Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-Tenant-Name: admin Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User: admin Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Domain-Id: default Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Domain-Name: Default Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Id: 30014035e7d641d5aecffdbe884d3d52 Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: X-User-Name: admin Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: method: > Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: exception: Flavor 451 could not be found. Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: action_args: {'id': '451'} Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:26:44.234022 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:44.235128 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: ERROR nova.api.openstack.wsgi Jul 07 15:26:44.236544 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-bebeb2cb-2edd-4c0c-820e-adcdad5e2e8d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:26:44.237828 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-bebeb2cb-2edd-4c0c-820e-adcdad5e2e8d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012125 Jul 07 15:26:44.237828 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Jul 7 15:26:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 15:26:45.054951 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:45.055971 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jul 07 15:26:45.056363 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:26:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:45.247010 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-9b1a9eb7-7997-4ca2-877c-88fba6c9d0c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:45.329078 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-9b1a9eb7-7997-4ca2-877c-88fba6c9d0c9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.134632 Jul 07 15:26:45.329618 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Jul 7 15:26:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:26:46.165212 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:46.166225 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001908 Jul 07 15:26:46.166626 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:26:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:46.354879 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-f77618e4-0186-4198-800d-3ea3b366fcc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:46.460375 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-f77618e4-0186-4198-800d-3ea3b366fcc1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.156151 Jul 07 15:26:46.460913 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Jul 7 15:26:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:26:47.283250 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:47.284281 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 07 15:26:47.284669 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:26:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:47.472390 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-2fc43efc-af95-4d8c-a63f-889d8cffd275 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:47.580314 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-2fc43efc-af95-4d8c-a63f-889d8cffd275 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.159379 Jul 07 15:26:47.580850 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Jul 7 15:26:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:26:48.418904 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:48.419971 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 07 15:26:48.420428 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:26:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:48.609185 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-44160045-8b1e-4ddc-bbdb-f9332d0ac2fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:26:48.672334 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-44160045-8b1e-4ddc-bbdb-f9332d0ac2fd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.114577 Jul 07 15:26:48.672801 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Jul 7 15:26:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:26:49.493212 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:49.494205 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jul 07 15:26:49.494599 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:26:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:26:49.679960 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-65bc8906-f049-49e1-ab73-361fbc300800 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:26:49.700281 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-65bc8906-f049-49e1-ab73-361fbc300800 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069790 Jul 07 15:26:49.700815 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Thu Jul 7 15:26:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:27:35.943366 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:27:35.944400 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-58b1bf4b-d76d-4668-bf03-e6ad209eb395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 07 15:27:35.944789 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Thu Jul 7 15:27:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:27:35.955045 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:27:36.003064 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-aaa038d4-cb72-4d18-9514-b64091f35497 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:27:36.021828 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-aaa038d4-cb72-4d18-9514-b64091f35497 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071225 Jul 07 15:27:36.022356 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Thu Jul 7 15:27:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:27:36.045207 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-d61e0f59-d350-417c-997e-efb4e362a407 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:27:36.048600 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG dbcounter [-] [103549] Writing DB stats nova_api:SELECT=14 {{(pid=103549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:27:36.053498 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-d61e0f59-d350-417c-997e-efb4e362a407 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012352 Jul 07 15:27:36.054010 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Thu Jul 7 15:27:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:27:36.066099 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-b2f4b63e-4be1-44ff-b039-3874f697a035 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:27:36.074120 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-b2f4b63e-4be1-44ff-b039-3874f697a035 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011942 Jul 07 15:27:36.074659 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Thu Jul 7 15:27:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:27:36.085715 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:27:36.093334 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011105 Jul 07 15:27:36.093839 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Thu Jul 7 15:27:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:27:36.105268 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-743adbb4-6506-4b13-b5d4-09b8e601c90a admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:27:36.112878 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-743adbb4-6506-4b13-b5d4-09b8e601c90a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011653 Jul 07 15:27:36.113388 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Thu Jul 7 15:27:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:30:57.485761 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:30:57.486765 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 07 15:30:57.487157 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:30:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:30:57.625992 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_api:SELECT=6 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:30:57.738172 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-eeaa6e86-2b67-49d8-9107-567e5b8d0a0a admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:30:57.739328 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 15:30:57.739328 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: warnings.warn(msg) Jul 07 15:30:57.740557 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-eeaa6e86-2b67-49d8-9107-567e5b8d0a0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:30:57.741003 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-eeaa6e86-2b67-49d8-9107-567e5b8d0a0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:30:57.741784 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-eeaa6e86-2b67-49d8-9107-567e5b8d0a0a admin admin] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:30:57.742213 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-eeaa6e86-2b67-49d8-9107-567e5b8d0a0a admin admin] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:30:57.776025 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-eeaa6e86-2b67-49d8-9107-567e5b8d0a0a admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151550 Jul 07 15:30:57.776577 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Jul 7 15:30:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:30:58.596935 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:30:58.597932 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 07 15:30:58.598916 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:30:58.790910 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-539709ac-2daa-42a6-81d4-78b6dfa911b9 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:30:58.792225 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 15:30:58.792225 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: warnings.warn(msg) Jul 07 15:30:58.793395 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-539709ac-2daa-42a6-81d4-78b6dfa911b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:30:58.793836 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-539709ac-2daa-42a6-81d4-78b6dfa911b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:30:58.794607 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-539709ac-2daa-42a6-81d4-78b6dfa911b9 admin admin] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:30:58.795059 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-539709ac-2daa-42a6-81d4-78b6dfa911b9 admin admin] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:30:58.814272 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-539709ac-2daa-42a6-81d4-78b6dfa911b9 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076078 Jul 07 15:30:58.814743 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Jul 7 15:30:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:31:10.068068 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:31:10.069118 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 07 15:31:10.069511 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:31:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:31:10.213337 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_cell0:SELECT=4 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:31:10.214088 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_cell1:SELECT=4 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:31:10.214708 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG dbcounter [-] [103550] Writing DB stats nova_api:SELECT=8 {{(pid=103550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:31:10.270201 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-aae2708f-0810-41c3-a9e1-50883e5e7fd7 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:31:10.271373 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 15:31:10.271373 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: warnings.warn(msg) Jul 07 15:31:10.272598 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-aae2708f-0810-41c3-a9e1-50883e5e7fd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:31:10.273051 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-aae2708f-0810-41c3-a9e1-50883e5e7fd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:31:10.273841 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-aae2708f-0810-41c3-a9e1-50883e5e7fd7 admin admin] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:31:10.279621 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-aae2708f-0810-41c3-a9e1-50883e5e7fd7 admin admin] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:31:10.300287 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-aae2708f-0810-41c3-a9e1-50883e5e7fd7 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091335 Jul 07 15:31:10.300845 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Jul 7 15:31:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:31:11.128786 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: DEBUG nova.api.openstack.wsgi [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] Calling method '>' {{(pid=103549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:31:11.129781 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: INFO nova.api.openstack.requestlog [None req-d684c5d1-4be8-48d4-a05c-c73e9f5e3785 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 07 15:31:11.130171 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: [pid: 103549|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Jul 7 15:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:31:11.320021 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG nova.api.openstack.wsgi [None req-ce597cb2-64ad-4f1d-b74d-90351fbf7729 admin admin] Calling method '>' {{(pid=103550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:31:11.321206 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 15:31:11.321206 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: warnings.warn(msg) Jul 07 15:31:11.322379 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-ce597cb2-64ad-4f1d-b74d-90351fbf7729 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:31:11.322819 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-ce597cb2-64ad-4f1d-b74d-90351fbf7729 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:31:11.323621 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-ce597cb2-64ad-4f1d-b74d-90351fbf7729 admin admin] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:31:11.324051 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: DEBUG oslo_concurrency.lockutils [None req-ce597cb2-64ad-4f1d-b74d-90351fbf7729 admin admin] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:31:11.345378 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: INFO nova.api.openstack.requestlog [None req-ce597cb2-64ad-4f1d-b74d-90351fbf7729 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078062 Jul 07 15:31:11.345920 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: [pid: 103550|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Jul 7 15:31:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:32:09.118846 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: Thu Jul 7 15:32:09 2022 - graceful shutdown triggered... Jul 07 15:32:09.119389 dv-cinder-841302-5-iscsi devstack@n-api.service[103550]: Gracefully killing worker 2 (pid: 103550)... Jul 07 15:32:09.119820 dv-cinder-841302-5-iscsi devstack@n-api.service[103549]: Gracefully killing worker 1 (pid: 103549)... Jul 07 15:32:09.119609 dv-cinder-841302-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 07 15:32:10.120001 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: worker 1 buried after 1 seconds Jul 07 15:32:10.120473 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: worker 2 buried after 1 seconds Jul 07 15:32:10.120473 dv-cinder-841302-5-iscsi devstack@n-api.service[103546]: goodbye to uWSGI. Jul 07 15:32:10.121571 dv-cinder-841302-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 07 15:32:10.122115 dv-cinder-841302-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 07 15:32:10.124927 dv-cinder-841302-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 07 15:32:10.134011 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 07 15:32:10.136701 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 15:32:10 2022] *** Jul 07 15:32:10.136857 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 15:32:10.136991 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 15:32:10.137103 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: nodename: dv-cinder-841302-5-iscsi Jul 07 15:32:10.137218 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: machine: x86_64 Jul 07 15:32:10.137418 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: clock source: unix Jul 07 15:32:10.137530 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: pcre jit disabled Jul 07 15:32:10.137638 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: detected number of CPU cores: 4 Jul 07 15:32:10.137745 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: current working directory: / Jul 07 15:32:10.137853 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: detected binary path: /usr/bin/uwsgi-core Jul 07 15:32:10.137966 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: your processes number limit is 47680 Jul 07 15:32:10.138096 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: your memory page size is 4096 bytes Jul 07 15:32:10.138227 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: detected max file descriptor number: 2048 Jul 07 15:32:10.138227 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: lock engine: pthread robust mutexes Jul 07 15:32:10.138438 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: thunder lock: enabled Jul 07 15:32:10.138575 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 07 15:32:10.138675 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 15:32:10.185996 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: Python main interpreter initialized at 0x555d87f7d9c0 Jul 07 15:32:10.185996 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: python threads support enabled Jul 07 15:32:10.185996 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: your server socket listen backlog is limited to 100 connections Jul 07 15:32:10.185996 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: your mercy for graceful operations on workers is 90 seconds Jul 07 15:32:10.186407 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 15:32:10.186407 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: *** Operational MODE: preforking *** Jul 07 15:32:10.186626 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: *** uWSGI is running in multiple interpreter mode *** Jul 07 15:32:10.186626 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: spawned uWSGI master process (pid: 124703) Jul 07 15:32:10.186829 dv-cinder-841302-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 07 15:32:10.188931 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: spawned uWSGI worker 1 (pid: 124719, cores: 1) Jul 07 15:32:10.188931 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: spawned uWSGI worker 2 (pid: 124720, cores: 1) Jul 07 15:32:10.188931 dv-cinder-841302-5-iscsi devstack@n-api.service[124703]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 15:32:10.841045 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 15:32:10.859026 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 15:32:12.040350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 15:32:12.040350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: from cryptography.utils import int_from_bytes Jul 07 15:32:12.040949 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 15:32:12.040949 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: from cryptography.utils import int_from_bytes Jul 07 15:32:12.070213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 15:32:12.070213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: from cryptography.utils import int_from_bytes Jul 07 15:32:12.070772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 15:32:12.070772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: from cryptography.utils import int_from_bytes Jul 07 15:32:14.338059 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 15:32:14.338601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 15:32:14.338884 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 15:32:14.339182 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 15:32:14.339489 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 15:32:14.339899 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.340229 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.340554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.340874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.341204 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.341513 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.341831 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.342149 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.342474 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.342732 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.343044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.343367 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-5-iscsi {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.343709 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.344017 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.344325 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.344640 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.344940 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.345256 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.345561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.346057 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.347541 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.347541 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.347541 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.348774 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.348774 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.349214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.349443 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.349662 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.349880 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.350171 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.350591 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-5-iscsi {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.350931 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.351247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.351715 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.351976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.352308 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.352631 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.352982 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.353286 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.353596 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.353923 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.354244 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.354559 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.354879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.355181 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.355490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.355826 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.356143 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.356704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.357010 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.357259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.357569 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.357888 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.358206 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.358381 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 15:32:14.358921 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.359100 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 15:32:14.359256 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.359256 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.359559 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 15:32:14.359761 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.359911 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 15:32:14.360057 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.360205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 15:32:14.360361 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.360517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.360688 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.360843 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.361012 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.361160 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.361325 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.361479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.361631 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.361631 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.361932 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.362078 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.362236 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.362400 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.362556 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.362703 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.362887 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.363064 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.363239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.363239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.363520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.363520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.363850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.364026 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.364177 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-5-iscsi {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.364177 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.365022 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.365188 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.365347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.365511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.365677 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.365825 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.365978 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.366133 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.366280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.366436 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.366583 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.366754 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.366983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.366983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.367285 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.367475 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.367682 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.367836 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.368430 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.368601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.368860 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.369026 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.369184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.369339 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.369493 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.369641 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.369800 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.369969 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.370123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.370277 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.370423 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.370584 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.370739 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.370886 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.371042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.371190 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.371190 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.371489 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-5-iscsi {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.371669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.371820 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.371988 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.372146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.372309 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.372456 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.372601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.372747 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.372900 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.373052 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.373211 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.373367 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.373513 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.373666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.373819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.373975 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.374138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.374285 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.374432 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.374618 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.375394 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.375584 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.375752 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.375903 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.376058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.376058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.376334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.376504 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.376658 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.376812 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.376980 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.377213 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.377365 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.377512 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.377665 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.377820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.377984 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.378131 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.378284 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.378284 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.378587 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.378748 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.378914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.378914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.379213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.379365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.379523 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.379722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.379878 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.379878 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.380168 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.380314 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.380488 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.380645 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.380793 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.380938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.381094 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.381240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.381394 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.381542 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.381693 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.381839 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.381985 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.382131 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.382296 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.382443 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.382635 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.382786 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.382932 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.383076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.383239 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.383239 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.384068 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.384242 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.384393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.384547 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.384707 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.385487 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.385662 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.385813 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.385960 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.386116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.386263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.386411 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.386557 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.386702 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.386857 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.387020 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.387186 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.387416 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.387642 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.387807 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.387961 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.388117 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.388271 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.388426 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.388573 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.388726 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.388881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.389051 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.389205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.389353 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.389510 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.389657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.389812 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.389966 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.390113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.390259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.390259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.390543 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.390698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.390845 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.390990 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.391143 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.391290 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.391452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.391634 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.391793 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.391946 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.392093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.392247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.392399 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.392559 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.392707 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.392859 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.393005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.393158 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.393314 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.393478 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.393624 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.393771 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.393916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.394075 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.394235 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.394879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.395047 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.396150 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.396310 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.396458 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.396615 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.396763 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.396922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.397076 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.397231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.397403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.397633 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.397791 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.397939 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.398092 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.398246 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.398404 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.398560 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.398707 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.398871 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.399030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.399177 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.399337 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.399494 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.399665 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.399896 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.400046 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.400200 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.400347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.400500 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.400652 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.400817 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.400976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.401131 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.401284 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.401430 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.401430 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.401723 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.401871 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.402025 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.402179 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.402333 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.402479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.402644 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.402799 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.402957 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.403119 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.403278 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.403425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.403606 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.403775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.403932 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.404078 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.404225 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.404378 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.404524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.404679 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.404834 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.404997 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.405144 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.405144 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.406203 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.406203 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.406493 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.406649 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.406804 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.406950 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.407105 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.407251 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.407398 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.407544 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.407793 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.407946 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.408109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.408256 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.408403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.408548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.408703 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.408850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 15:32:14.409032 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.409032 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.409440 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.409596 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.409758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.409914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.410615 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.410775 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.410922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.411068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.411213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.411370 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.411517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.411688 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.411836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.411982 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.412140 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.412317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.412481 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.412638 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.412786 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.412932 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.413091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.413239 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.413385 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.413531 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.413679 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.413825 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.413981 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.414138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.414286 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.414440 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.414595 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.414743 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.414899 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.415053 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.415200 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.415370 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.416003 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.416346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.416506 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.416653 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.416820 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.416975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.417130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.417291 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.417291 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.417586 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.417586 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.417968 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.418129 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.418295 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.418295 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.418571 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.418717 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.418881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.419038 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.419199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.419353 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.419506 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.419696 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.419855 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.420003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.420163 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.420309 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.420462 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.420609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.420754 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.420920 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.421068 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.421214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.421445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.421602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.421755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.421912 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.422067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.422213 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.422359 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.422721 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.422869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.423037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.423186 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.426522 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.426707 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.426889 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.427055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.427220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.427386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.427537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.427739 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.427899 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.428148 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.428306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.428475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.428630 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.428783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.428936 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.429095 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.429252 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.429252 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.429539 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.429539 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.429822 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.429978 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.430125 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.430299 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.430597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.430597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.430888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.431044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.431192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.431338 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.431485 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.431700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.431861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.432091 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.432241 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.432403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.432557 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.432756 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.432918 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.433065 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.433220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.433373 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.433520 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.433666 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.433821 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.433974 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.434121 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.434281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.434448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.434709 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.434895 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.435050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.435209 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.435369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.435529 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.435735 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.435903 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.436556 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.436750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.436989 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.437149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.437313 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.437479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.437633 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.437794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.437948 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.438127 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.438363 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.438531 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.438685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.438839 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.439050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.439208 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.439368 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.439511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.439692 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.439835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.439989 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.440144 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.440299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.440453 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.440593 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.440734 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.440880 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.441030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.441171 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.441349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.441504 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.441659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.441800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.441952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.442093 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.442247 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.442387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.442541 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.442680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.442840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.442982 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.443134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.443287 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.443441 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.443606 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.443767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.443908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.444063 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.444203 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.444345 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.444505 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.444652 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.444792 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.444931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.445071 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.445212 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.445373 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.445515 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.445654 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.445805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.445945 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.446086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.446334 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.446906 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.447153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.447306 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.447460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.447648 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.447804 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.447964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.448118 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.448259 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.448486 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.448637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.448798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.448798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.449093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.449234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.449388 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.449550 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.449705 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.449856 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.450006 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.450146 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.450296 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.450458 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.450612 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.450751 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.450891 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.451041 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.451194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.451348 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.451488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.451488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.451488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.451906 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.452046 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.452046 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.452329 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.452469 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.452469 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.452744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.452894 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.453046 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.453186 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.453186 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.453447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.453585 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.453585 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.453878 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.454018 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.454018 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.454279 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.454430 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.454590 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.454732 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.454732 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.454993 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.455145 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.455145 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.455430 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.455600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.455600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.455881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.456034 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.456186 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.456341 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.456341 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.457693 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.457836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.457976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.458137 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.458137 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.458413 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.458643 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.458799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.458939 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.458939 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.458939 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.459375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.459519 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.459519 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.459828 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.459987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.459987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.460258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.460408 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.460408 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.460681 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.460837 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.460989 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.461143 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.461143 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.461425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.461578 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.461578 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.461856 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.462009 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.462009 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.462282 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.462506 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.462506 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.462772 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.462925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.462925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.463216 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.463355 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.463355 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.463657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.463811 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.463953 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.464115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.464115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.464389 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.464529 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.464529 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.464808 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.464960 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.464960 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.465224 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.465375 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.465529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.465683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.465835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.465985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.465985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.466295 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.466437 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.466437 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.467018 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.467113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.467201 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.467302 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.467302 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.467485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.467820 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.467820 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.467981 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468085 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468175 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468260 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468260 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468430 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468526 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468526 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468711 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468797 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468797 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.468960 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469151 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469238 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469238 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469493 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469493 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469670 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469764 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469764 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.469929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470020 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470118 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470300 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470392 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470392 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470556 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470651 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470651 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470911 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.470911 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471179 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471179 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471335 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.471794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.472202 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.472289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.472289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.472289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.472289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.472289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.473226 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.473315 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.473315 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.473315 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.473315 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.473631 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.473789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.473912 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.474115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.474334 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.474429 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.474715 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.474933 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.475062 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.475371 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.475490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.475752 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.476012 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.476104 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.476418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.476564 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.476729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.477167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.477265 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.477353 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.477681 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.477966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.477966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.478153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.478248 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.478529 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.478712 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.478842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.479149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.479242 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.479466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.479772 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.479886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.480110 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.480337 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.480432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.480718 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.480909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.481030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.481596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.481704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.481916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.482192 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.482336 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.482522 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.482820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.482926 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.483131 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.483427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.483530 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.483776 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.484016 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.484131 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.484385 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.484575 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.484706 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.485014 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.485142 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.485323 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.485629 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.485735 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.485942 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.486200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.486300 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.486547 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.486757 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.486865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.487295 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.487413 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.487518 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.487791 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.487914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.488211 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.488396 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.488499 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.488713 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.488984 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.489078 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.489684 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.489780 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.489883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.489978 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.490196 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.490298 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.490539 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.490781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.490953 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.491256 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.491371 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.491462 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.491796 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.491937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.492084 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.492396 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.492545 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.492707 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.493015 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.493117 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.493344 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.493608 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.493710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.493956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.494193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.494311 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.494557 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.494804 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.494898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.495196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.495388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.495559 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.495888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.495982 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.496207 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.496715 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.496829 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.496829 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.497014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.497476 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.497599 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.497696 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.497798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.498050 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.498169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.498463 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.498627 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.498721 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.498961 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.499197 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.499292 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.499595 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.499805 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.499900 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.500224 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.500385 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.500547 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.500873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.500973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.501201 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.501447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.501542 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.501805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.502024 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.502176 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.502420 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.502524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.502733 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.502923 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.503025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.503541 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.503784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.503784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.503964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.504053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.504335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.504441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.504647 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.504832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.505029 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.505325 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.505426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.505739 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.506506 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.506635 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.506742 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.506833 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.506921 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.507016 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.507016 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.507191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.507304 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.507654 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.507765 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.507874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.508102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.508216 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.508538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.508655 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.508914 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.509023 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.509257 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.509479 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.509579 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.509841 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.509973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.510164 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.510411 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.510513 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.510786 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.510882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.511093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.511370 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.511514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.511835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.511930 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.512170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.512340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.512485 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.512792 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.512885 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.513096 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.513305 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.513446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.513761 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.513860 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.514122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.514300 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.514503 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.514743 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.514838 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.515126 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.515237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.515435 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.515702 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.515814 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.516141 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.516236 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.516491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.516640 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.516801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.517086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.517220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.517529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.517644 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.517894 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.518033 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.518152 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.518462 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.518585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.518787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.518976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.519083 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.519938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.520045 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.520252 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.520452 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.520583 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.520894 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.520987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.521210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.521387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.521528 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.521835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.521929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.522161 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.522333 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.522486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.522770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.522876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.523112 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.523265 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.523529 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.523755 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.523879 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.524157 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.524260 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.524512 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.524640 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.524844 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.525154 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.525248 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.525467 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.525649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.525793 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.525971 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.526098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.526285 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527319 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527696 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527782 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527880 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.527965 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.528039 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.528224 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.528319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.528535 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.528645 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.528861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.528957 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.529174 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.529280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.529491 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.529581 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.529805 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.529886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.530122 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.530204 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.530447 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.530549 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.530754 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.530844 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.531062 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.531161 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.531370 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.531463 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.531722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.531920 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.532089 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.532253 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.532416 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.532576 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.532749 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.532906 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.533065 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.533175 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.533374 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.533485 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.533705 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.533798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.534036 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.534140 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.534349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.534444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.534685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.534799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.535544 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.535695 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.535900 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.535997 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.536211 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.536322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.536529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.536654 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.536841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.536969 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.537222 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.537342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.537526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.537653 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.537842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.537947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.538157 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.538258 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.538460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.538564 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.538772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.538872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.539077 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.539171 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.539386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.539494 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.539722 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.539830 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.540138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.540270 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.540374 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.540470 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.540671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.540774 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.540981 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.541075 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.541288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.541392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.541596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.541689 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.541903 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.542011 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.542245 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.542347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.542553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.542654 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.542859 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.542962 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.543182 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.543283 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.543490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.543606 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.543832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.543940 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.544147 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.544243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.544460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.544563 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.544767 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.544869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.545075 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.545182 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.545396 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.545488 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.545704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.545805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.546026 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.546118 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.546341 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.546432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.546659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.546752 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.546974 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.547067 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.547278 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.547369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.547625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.547739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.547942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.548040 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.548254 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.548509 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.548632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.548847 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.548952 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.549168 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.549275 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.549484 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.549586 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.549799 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.549892 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.550118 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.550225 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.550437 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.550543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.550775 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.550875 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.551086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.551178 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.551400 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.551501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.551814 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.551908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.552137 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.552238 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.552462 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.552563 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.552770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.552870 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.553080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.553183 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.553393 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.553487 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.553704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.553803 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.554011 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.554114 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.554316 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.554417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.554626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.554725 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.554932 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.555026 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.555237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.555338 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.555542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.555721 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.555887 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.555988 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.556193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.556286 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.556515 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.556612 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.556827 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.556922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.557135 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.557235 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.557441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.557541 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.557748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.557842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.558060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.558153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.558379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.558482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.558699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.558798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.559021 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.559133 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.559344 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.559450 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.559698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.559795 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.560017 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.560108 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.560335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.560457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.560657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.560769 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.560976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.561175 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.561278 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.561498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.561600 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.561838 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.561931 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.562168 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.562271 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.562498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.562592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.562812 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.562912 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.563132 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.563239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.563452 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.563546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.563787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.563881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.564097 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.564342 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.564445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.564676 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.564770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.564994 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.565096 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.565311 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.565405 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.565625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.565718 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.565936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.566043 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.566772 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.566882 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.567084 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.567176 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.567394 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.567637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.567749 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.567990 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.568084 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.568312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.568406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.568640 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.568780 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.568970 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.569195 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.569301 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.569398 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.569584 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.569688 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.569908 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.570002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.570217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.570329 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.570525 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.570671 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.570876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.570975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.571149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.571243 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.571454 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.571548 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.571785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.571881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.572097 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.572200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.572408 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.572502 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.572715 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.572810 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.573028 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.573129 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.573332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.573424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.573650 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.573742 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.573954 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.574054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.574261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.574362 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.574565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.574707 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.574873 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.574995 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.575174 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.575276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.575479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.575620 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.575809 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.575914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.576115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.576210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.576427 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.576534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.576731 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.576833 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.577045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.577352 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.577447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.577667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.577761 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.577973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.578068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.578281 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.578383 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.578629 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.578721 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.578952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.579045 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.579264 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.579381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.579607 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.579706 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.579910 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.580007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.580216 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.580364 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.580532 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.580625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.580856 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.580992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.581145 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.581238 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.581468 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.581561 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.581780 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.581916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.582625 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.582876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.582980 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.583213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.583320 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.583538 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.583818 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.583924 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.584169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.584270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.584492 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.584586 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.584803 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.584904 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.585111 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.585239 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.585435 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.585543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.585747 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.585841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.586059 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.586158 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.586370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.586473 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.586677 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.586769 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.586988 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.587080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.587301 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.587406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.587906 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.588019 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.588258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.588359 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.588530 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.588636 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.588842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.588937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.589149 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.589253 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.589465 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.589573 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.589770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.589864 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.590086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.590181 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.590401 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.590501 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.590708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.590808 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.591016 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.591135 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.591332 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.591445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.591659 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.591771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.591965 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.592068 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.592270 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.592363 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.592574 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.592668 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.592888 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.592996 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.593192 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.593287 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.593503 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.593596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.593808 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.593915 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.594121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.594222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.594424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.594527 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.594735 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.594842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.595088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.595193 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.595414 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.595507 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.595748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.595853 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.596055 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.596157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.596373 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.596476 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.596684 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.596779 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.597009 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.597103 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.597324 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.597425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.597819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.597910 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.597996 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.598088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.598301 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.598408 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.598640 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.598832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.598933 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.599168 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.599262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.599503 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.599695 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.599855 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.599971 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.600180 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.600284 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.600497 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.600619 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.600806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.600929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.601134 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.601263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.601421 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.601566 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.601731 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.601831 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.602037 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.602213 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.602346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.602439 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.602649 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.602742 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.602959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.603061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.603264 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.603365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.603596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.603706 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.603898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.604005 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.604205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.604306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.604516 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.604610 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.604823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.604925 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.605133 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.605234 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.605441 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.605534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.605750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.605845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.606060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.606178 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.606623 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.606725 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.606932 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.607027 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.607267 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.607360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.607602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.607699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.607920 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.608016 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.608234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.608327 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.608546 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.608653 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.608857 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.608960 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.609170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.609318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.609497 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.609601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.609812 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.609906 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.610121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.610214 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.610432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.610533 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.610769 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.610872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.611088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.611204 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.611409 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.611549 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.611749 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.611845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.612063 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.612157 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.612376 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.612716 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.612818 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.612906 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.612992 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.613106 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.613349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.613445 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.613662 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.613756 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.613990 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.614091 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.614316 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.614417 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.614642 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.614734 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.614953 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.615061 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.615261 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.615356 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.615588 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.615732 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.615901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.616007 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.616218 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.616312 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.616531 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.616630 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.616838 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.616940 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.617142 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.617235 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.617453 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.617545 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.617760 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.617854 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.618067 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.618162 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.618374 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.618468 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.618679 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.618782 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.618988 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.619088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.619291 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.619394 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.619620 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.619719 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.619930 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.620034 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.620234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.620335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.620545 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.620640 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.620851 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.620945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.621165 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.621271 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.621477 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.621592 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.621781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.621878 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 15:32:14.622088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.622393 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.622697 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.623029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.623365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.623706 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.624034 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.624353 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.624680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.624992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.625317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.625643 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.625968 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.626280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.626617 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.626930 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.627248 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.627596 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.627900 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.628214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.628530 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.629404 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.629736 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.630049 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.630380 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.630709 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.631043 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.631363 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.631711 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.632048 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.632366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.632682 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.633005 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.633324 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.633639 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.633959 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.634277 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.634610 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.634940 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.635254 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.635599 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.635935 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.636296 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.636616 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.636972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.637306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.637628 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.637949 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.638260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 15:32:14.638506 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 15:32:14.775729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO dbcounter [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Registered counter for database nova_api Jul 07 15:32:14.793271 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO dbcounter [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Registered counter for database nova_api Jul 07 15:32:14.796438 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_db.sqlalchemy.engines [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:32:14.803854 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writer thread running {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:32:14.811218 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_db.sqlalchemy.engines [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:32:14.818536 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writer thread running {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:32:14.864502 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.context [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316eb91c-3dad-4e42-84e1-39a08b9618c9(cell1) {{(pid=124719) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 15:32:14.868406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:32:14.870002 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:32:14.870828 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:32:14.872815 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:32:14.874680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.context [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316eb91c-3dad-4e42-84e1-39a08b9618c9(cell1) {{(pid=124720) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 15:32:14.874806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO dbcounter [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Registered counter for database nova_cell0 Jul 07 15:32:14.878591 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:32:14.879436 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO dbcounter [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Registered counter for database nova_cell1 Jul 07 15:32:14.880738 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:32:14.881561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:32:14.883542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:32:14.887681 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO dbcounter [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Registered counter for database nova_cell0 Jul 07 15:32:14.887840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_db.sqlalchemy.engines [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:32:14.889497 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_db.sqlalchemy.engines [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:32:14.889773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO dbcounter [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Registered counter for database nova_cell1 Jul 07 15:32:14.893817 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writer thread running {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:32:14.897217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writer thread running {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:32:14.897428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_db.sqlalchemy.engines [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:32:14.899325 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_db.sqlalchemy.engines [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:32:14.904915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writer thread running {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:32:14.907415 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writer thread running {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:32:15.043853 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO dbcounter [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Registered counter for database nova_cell0 Jul 07 15:32:15.052721 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_db.sqlalchemy.engines [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:32:15.053059 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO dbcounter [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Registered counter for database nova_cell0 Jul 07 15:32:15.059829 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_db.sqlalchemy.engines [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 15:32:15.059984 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writer thread running {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:32:15.064608 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writer thread running {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 15:32:15.389191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: WARNING keystonemiddleware.auth_token [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 15:32:15.393325 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: WARNING keystonemiddleware.auth_token [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 15:32:15.399215 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: WARNING keystonemiddleware.auth_token [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 15:32:15.402722 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: WARNING keystonemiddleware.auth_token [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 15:32:15.755531 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: WARNING keystonemiddleware.auth_token [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 15:32:15.761535 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: WARNING keystonemiddleware.auth_token [None req-13c9a8ae-a746-4784-b554-db1020b8f3c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 15:32:15.761778 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: WARNING keystonemiddleware.auth_token [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 15:32:15.766886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d87f7d9c0 pid: 124719 (default app) Jul 07 15:32:15.767821 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: WARNING keystonemiddleware.auth_token [None req-72aa6a95-3072-44bb-ae52-fcb3ee6beb62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 15:32:15.773583 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d87f7d9c0 pid: 124720 (default app) Jul 07 15:32:58.328337 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=3 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:32:58.329308 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=3 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:32:58.330294 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=3 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:32:58.333309 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=3 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:32:58.978166 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a3484d55-60fd-4f59-a94c-11f48f1b3855 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Action: 'create', calling method: .version_select at 0x7f524b60e5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1377566517"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:00.645155 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a3484d55-60fd-4f59-a94c-11f48f1b3855 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.328989 Jul 07 15:33:00.646265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1154 bytes} [Thu Jul 7 15:32:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2333 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 07 15:33:00.660257 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-00525d6f-11c2-4ee5-82f0-69378ca7427e tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d3430>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:00.760330 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-00525d6f-11c2-4ee5-82f0-69378ca7427e tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815" status: 200 len: 345 microversion: 2.1 time: 0.106243 Jul 07 15:33:00.761172 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:33:00 2022] GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:33:00.999737 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-60dd5d3c-60ac-4d34-8b11-0cceda1bcaab tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b73a160>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:01.137040 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:01.137040 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:01.137040 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:01.137040 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:01.632941 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-60dd5d3c-60ac-4d34-8b11-0cceda1bcaab tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/26363e60-4ef1-4a7b-bf59-486c008f5104" status: 200 len: 350 microversion: 2.1 time: 1.087585 Jul 07 15:33:01.632941 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:33:00 2022] GET /compute/v2.1/os-volumes/26363e60-4ef1-4a7b-bf59-486c008f5104 => generated 350 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:01.773540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f158a71f-ab25-4791-bdbd-8f118ff473ad tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d3af0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:01.939120 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f158a71f-ab25-4791-bdbd-8f118ff473ad tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815" status: 200 len: 346 microversion: 2.1 time: 0.169111 Jul 07 15:33:01.939696 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:33:01 2022] GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 => generated 346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:01.953849 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0a240039-5621-4949-95f5-32bcc5568e45 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Action: 'create', calling method: .version_select at 0x7f524b537430>, body: {"snapshot": {"volume_id": "a248c40d-ebe7-450c-b3cd-c161ae961815", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-48837039"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:02.844952 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0a240039-5621-4949-95f5-32bcc5568e45 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.896989 Jul 07 15:33:02.857503 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 2/5] 10.222.0.25 () {60 vars in 1161 bytes} [Thu Jul 7 15:33:01 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:33:02.860502 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0597b822-e0fc-46c8-a35b-b152f24976aa tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d3d30>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:02.973264 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0597b822-e0fc-46c8-a35b-b152f24976aa tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8" status: 200 len: 285 microversion: 2.1 time: 0.120960 Jul 07 15:33:02.979220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Jul 7 15:33:02 2022] GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:33:02.985171 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-be3aeca8-d150-418d-bec1-b20ba77a5ec2 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b537c10>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:03.037106 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-be3aeca8-d150-418d-bec1-b20ba77a5ec2 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.056458 Jul 07 15:33:03.037750 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1139 bytes} [Thu Jul 7 15:33:02 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:33:03.071144 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ad301ea5-9ee2-433e-896d-38f7e4dd8d84 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d34c0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:03.140609 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ad301ea5-9ee2-433e-896d-38f7e4dd8d84 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8" status: 200 len: 285 microversion: 2.1 time: 0.055847 Jul 07 15:33:03.140609 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Jul 7 15:33:03 2022] GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 => generated 285 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:03.788167 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-489070bd-1227-4405-9c18-10d10922358f tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b4d0940>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:03.886044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-489070bd-1227-4405-9c18-10d10922358f tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e006fef2-cadc-42b9-9b2e-2807bd9cd9db" status: 200 len: 351 microversion: 2.1 time: 0.103662 Jul 07 15:33:03.887987 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 4/9] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:33:03 2022] GET /compute/v2.1/os-volumes/e006fef2-cadc-42b9-9b2e-2807bd9cd9db => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:04.150139 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d9176cd0-4610-4716-9d95-94a4202d65bd tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4ec310>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:04.411746 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d9176cd0-4610-4716-9d95-94a4202d65bd tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8" status: 200 len: 285 microversion: 2.1 time: 0.268447 Jul 07 15:33:04.412376 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 6/10] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Jul 7 15:33:04 2022] GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 => generated 285 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:05.424805 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7476ebba-f20c-43fa-8a22-34a07bd848ff tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d0700>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:05.601958 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7476ebba-f20c-43fa-8a22-34a07bd848ff tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8" status: 200 len: 285 microversion: 2.1 time: 0.182010 Jul 07 15:33:05.602890 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 5/11] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Jul 7 15:33:05 2022] GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:06.616053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9ea212b7-d396-4be6-8fcd-4becba9fa8a2 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d3280>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:06.729379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9ea212b7-d396-4be6-8fcd-4becba9fa8a2 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8" status: 200 len: 285 microversion: 2.1 time: 0.118055 Jul 07 15:33:06.736294 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Jul 7 15:33:06 2022] GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:07.087467 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ac0a23a0-65cf-4f2d-8a35-3696aaf81899 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b6585e0>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:07.201674 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ac0a23a0-65cf-4f2d-8a35-3696aaf81899 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/396e37ce-eb2e-45b4-bdae-5c236356f86e" status: 200 len: 351 microversion: 2.1 time: 0.118196 Jul 07 15:33:07.202856 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 6/13] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:33:07 2022] GET /compute/v2.1/os-volumes/396e37ce-eb2e-45b4-bdae-5c236356f86e => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:07.214005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-00417fb3-705f-458f-9c7e-eb308c967d7a tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b4d3b80>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:07.425597 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-00417fb3-705f-458f-9c7e-eb308c967d7a tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.215556 Jul 07 15:33:07.426637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 8/14] 10.222.0.25 () {58 vars in 1133 bytes} [Thu Jul 7 15:33:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:07.438994 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-47a73e5a-12f4-49cf-a841-a41ae6a0c82c tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b537f70>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:07.583733 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-47a73e5a-12f4-49cf-a841-a41ae6a0c82c tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.148508 Jul 07 15:33:07.584590 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 7/15] 10.222.0.25 () {58 vars in 1148 bytes} [Thu Jul 7 15:33:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:07.597284 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d2fa001a-b20c-479c-9201-de417ee458bc tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b4ec160>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:07.742336 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8ce0700b-310b-4c9e-a0de-76d491c075ee tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b64c550>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:07.796507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8ce0700b-310b-4c9e-a0de-76d491c075ee tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8" status: 200 len: 286 microversion: 2.1 time: 0.058027 Jul 07 15:33:07.797363 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Jul 7 15:33:07 2022] GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:07.809264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-78dee78b-c8f6-434c-b1f2-aa46fb961778 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d0ee0>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:07.819649 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d2fa001a-b20c-479c-9201-de417ee458bc tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.226610 Jul 07 15:33:07.827502 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1133 bytes} [Thu Jul 7 15:33:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:07.832830 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-edb2de74-6589-4c48-baba-ecb973d60b9c tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b4ec940>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:08.001327 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-78dee78b-c8f6-434c-b1f2-aa46fb961778 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8" status: 202 len: 0 microversion: 2.1 time: 0.197102 Jul 07 15:33:08.002422 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 9/18] 10.222.0.25 () {58 vars in 1253 bytes} [Thu Jul 7 15:33:07 2022] DELETE /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:33:08.010791 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4fde1fbb-3554-4ce1-b7c7-e0840c3805de tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d0790>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:08.070886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-edb2de74-6589-4c48-baba-ecb973d60b9c tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.243145 Jul 07 15:33:08.073053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 10/19] 10.222.0.25 () {58 vars in 1166 bytes} [Thu Jul 7 15:33:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:08.096177 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4fde1fbb-3554-4ce1-b7c7-e0840c3805de tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8" status: 200 len: 285 microversion: 2.1 time: 0.088944 Jul 07 15:33:08.101060 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 10/20] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Jul 7 15:33:08 2022] GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:08.129531 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1078f386-2e61-428b-a632-cd3def6625b9 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b53c0d0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:08.270444 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1078f386-2e61-428b-a632-cd3def6625b9 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.191153 Jul 07 15:33:08.275783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1169 bytes} [Thu Jul 7 15:33:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:33:08.290431 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-89138cb1-15bc-4ce9-9155-c20a054c3b93 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b5374c0>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:08.445776 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-89138cb1-15bc-4ce9-9155-c20a054c3b93 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.160155 Jul 07 15:33:08.453393 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 11/22] 10.222.0.25 () {58 vars in 1154 bytes} [Thu Jul 7 15:33:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:08.459238 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c0549854-9fcd-4cce-abc8-e9a78b5cb2f1 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b4d3ee0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:08.677265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c0549854-9fcd-4cce-abc8-e9a78b5cb2f1 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.222779 Jul 07 15:33:08.678628 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1187 bytes} [Thu Jul 7 15:33:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:33:08.692672 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-db07cb8c-624e-4609-8ad2-946575532b41 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] Calling method '.version_select at 0x7f524b4d0160>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:08.883504 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-db07cb8c-624e-4609-8ad2-946575532b41 tempest-VolumesTestJSON-1111244266 tempest-VolumesTestJSON-1111244266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.194848 Jul 07 15:33:08.896856 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1154 bytes} [Thu Jul 7 15:33:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:09.110344 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c0887187-011c-4c3a-a2b3-db7b447710d3 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d35e0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:09.155600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-c0887187-011c-4c3a-a2b3-db7b447710d3 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] HTTP exception thrown: Snapshot bbc04446-b25f-473b-81fd-bf0f880f1fc8 could not be found. Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c0887187-011c-4c3a-a2b3-db7b447710d3 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Request method failure captured: Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 HTTP/1.1 Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvyqK17mNc8H3Ft-dZ4OpphlvIWFhPrw3PCyD-5ef9jshDrpRuwxPlxd6gY-WbU1BN_dYxRl_6Pno-5pXmIcTmeYfQTndrrovz2Quo32JMHqChy-07wQvdTjlBBhrWf4c5UDPeHRoaQzy9SFPFY5nyU349-7Xu5dCj7hwY-cCB8gV6Q Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: d393195d103b48a1b8d17fc56b3ad594 Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:33:09.162989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d393195d103b48a1b8d17fc56b3ad594", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: d393195d103b48a1b8d17fc56b3ad594 Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesSnapshotsTestJSON-783687225-project Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: ee2aa825da1542d7a2f1355900e65173 Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesSnapshotsTestJSON-783687225-project Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Snapshot bbc04446-b25f-473b-81fd-bf0f880f1fc8 could not be found. Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'bbc04446-b25f-473b-81fd-bf0f880f1fc8'} Jul 07 15:33:09.164205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bbc04446-b25f-473b-81fd-bf0f880f1fc8 could not be found. (HTTP 404) (Request-ID: req-4df121be-a2ba-4d59-9abc-0ed7c4f5ed4d) Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:09.164967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:33:09.166565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bbc04446-b25f-473b-81fd-bf0f880f1fc8 could not be found. Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 07 15:33:09.167474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bbc04446-b25f-473b-81fd-bf0f880f1fc8 could not be found. Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bbc04446-b25f-473b-81fd-bf0f880f1fc8 could not be found. Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c0887187-011c-4c3a-a2b3-db7b447710d3 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Returning 404 to user: Snapshot bbc04446-b25f-473b-81fd-bf0f880f1fc8 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:33:09.173886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c0887187-011c-4c3a-a2b3-db7b447710d3 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8" status: 404 len: 111 microversion: 2.1 time: 0.059059 Jul 07 15:33:09.174511 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1fcaae8b-cd9c-4140-a5bd-73333ac75e28 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4e4670>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:09.179771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Jul 7 15:33:09 2022] GET /compute/v2.1/os-snapshots/bbc04446-b25f-473b-81fd-bf0f880f1fc8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:33:09.501407 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1fcaae8b-cd9c-4140-a5bd-73333ac75e28 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815" status: 202 len: 0 microversion: 2.1 time: 0.331019 Jul 07 15:33:09.502338 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 13/26] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:33:09 2022] DELETE /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:33:09.512157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2852def6-68a0-4927-a776-6368e4db865f tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524beb48b0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:09.596670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2852def6-68a0-4927-a776-6368e4db865f tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815" status: 200 len: 345 microversion: 2.1 time: 0.090104 Jul 07 15:33:09.597760 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:33:09 2022] GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:10.611595 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9fed0c47-d2cb-4d19-9561-11b72c28aa4a tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b537b80>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:10.710081 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-9fed0c47-d2cb-4d19-9561-11b72c28aa4a tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] HTTP exception thrown: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9fed0c47-d2cb-4d19-9561-11b72c28aa4a tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Request method failure captured: Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 HTTP/1.1 Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvyqK17mNc8H3Ft-dZ4OpphlvIWFhPrw3PCyD-5ef9jshDrpRuwxPlxd6gY-WbU1BN_dYxRl_6Pno-5pXmIcTmeYfQTndrrovz2Quo32JMHqChy-07wQvdTjlBBhrWf4c5UDPeHRoaQzy9SFPFY5nyU349-7Xu5dCj7hwY-cCB8gV6Q Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: d393195d103b48a1b8d17fc56b3ad594 Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:33:10.719815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d393195d103b48a1b8d17fc56b3ad594", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: d393195d103b48a1b8d17fc56b3ad594 Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-VolumesSnapshotsTestJSON-783687225-project Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: ee2aa825da1542d7a2f1355900e65173 Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-783687225-project Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'a248c40d-ebe7-450c-b3cd-c161ae961815'} Jul 07 15:33:10.721056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. (HTTP 404) (Request-ID: req-ecc16a24-c0be-4e33-b8c0-6fb3a82273de) Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:10.721799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:33:10.722865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 15:33:10.724080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.725152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.726881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9fed0c47-d2cb-4d19-9561-11b72c28aa4a tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Returning 404 to user: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:33:10.728027 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9fed0c47-d2cb-4d19-9561-11b72c28aa4a tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815" status: 404 len: 109 microversion: 2.1 time: 0.122331 Jul 07 15:33:10.740308 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:33:10 2022] GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:33:10.743957 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4b33bbc9-c6bd-4977-a927-190d97dada85 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524b4d34c0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-4b33bbc9-c6bd-4977-a927-190d97dada85 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] HTTP exception thrown: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4b33bbc9-c6bd-4977-a927-190d97dada85 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Request method failure captured: Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: DELETE /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 HTTP/1.1 Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvyqK17mNc8H3Ft-dZ4OpphlvIWFhPrw3PCyD-5ef9jshDrpRuwxPlxd6gY-WbU1BN_dYxRl_6Pno-5pXmIcTmeYfQTndrrovz2Quo32JMHqChy-07wQvdTjlBBhrWf4c5UDPeHRoaQzy9SFPFY5nyU349-7Xu5dCj7hwY-cCB8gV6Q Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: d393195d103b48a1b8d17fc56b3ad594 Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:33:10.822194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d393195d103b48a1b8d17fc56b3ad594", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: d393195d103b48a1b8d17fc56b3ad594 Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesSnapshotsTestJSON-783687225-project Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: ee2aa825da1542d7a2f1355900e65173 Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesSnapshotsTestJSON-783687225-project Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'a248c40d-ebe7-450c-b3cd-c161ae961815'} Jul 07 15:33:10.823445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. (HTTP 404) (Request-ID: req-c90ee7b6-8fd0-4cd2-8187-b50b856ba2f0) Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:10.824091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 15:33:10.824976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 15:33:10.825859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4b33bbc9-c6bd-4977-a927-190d97dada85 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Returning 404 to user: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4b33bbc9-c6bd-4977-a927-190d97dada85 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815" status: 404 len: 109 microversion: 2.1 time: 0.082235 Jul 07 15:33:10.827099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 15/29] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:33:10 2022] DELETE /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:33:10.847966 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d2e7cdbb-6044-4654-a268-4c071d1a30e4 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Calling method '.version_select at 0x7f524beb5af0>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:10.900301 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-d2e7cdbb-6044-4654-a268-4c071d1a30e4 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] HTTP exception thrown: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d2e7cdbb-6044-4654-a268-4c071d1a30e4 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Request method failure captured: Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 HTTP/1.1 Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvyqK17mNc8H3Ft-dZ4OpphlvIWFhPrw3PCyD-5ef9jshDrpRuwxPlxd6gY-WbU1BN_dYxRl_6Pno-5pXmIcTmeYfQTndrrovz2Quo32JMHqChy-07wQvdTjlBBhrWf4c5UDPeHRoaQzy9SFPFY5nyU349-7Xu5dCj7hwY-cCB8gV6Q Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: d393195d103b48a1b8d17fc56b3ad594 Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:33:10.904815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d393195d103b48a1b8d17fc56b3ad594", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d393195d103b48a1b8d17fc56b3ad594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: d393195d103b48a1b8d17fc56b3ad594 Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-783687225 Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-VolumesSnapshotsTestJSON-783687225-project Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: ee2aa825da1542d7a2f1355900e65173 Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-783687225-project Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'a248c40d-ebe7-450c-b3cd-c161ae961815'} Jul 07 15:33:10.905881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. (HTTP 404) (Request-ID: req-9d7129aa-db13-4c3a-b5f6-f9695c0f9ddf) Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:10.906543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:33:10.908058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 15:33:10.908999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d2e7cdbb-6044-4654-a268-4c071d1a30e4 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] Returning 404 to user: Volume a248c40d-ebe7-450c-b3cd-c161ae961815 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d2e7cdbb-6044-4654-a268-4c071d1a30e4 tempest-VolumesSnapshotsTestJSON-783687225 tempest-VolumesSnapshotsTestJSON-783687225-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815" status: 404 len: 109 microversion: 2.1 time: 0.075684 Jul 07 15:33:10.909866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 15/30] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:33:10 2022] GET /compute/v2.1/os-volumes/a248c40d-ebe7-450c-b3cd-c161ae961815 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:33:13.218448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-74cb9ea7-9329-4c3c-be51-2be8a3fd6744 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'create', calling method: .version_select at 0x7f524b448af0>, body: {"keypair": {"name": "tempest-keypair-920059883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXiQHeKy7s81DqhgF3xY4X7Hb5cRpw5OtAnw5VeqBf6sdPbrDUleSCqVvErW21bqAevasQXydf/UNrPILqm7MZIySL+kksQdYPQUUsIZc2cdWYu2ZcUjPKnqDI1TlsGNg=="}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:13.323215 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-74cb9ea7-9329-4c3c-be51-2be8a3fd6744 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Getting quotas for project 66a98614df914018b7ecfb68afb735c0. Resources: {'key_pairs'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:33:13.347268 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-74cb9ea7-9329-4c3c-be51-2be8a3fd6744 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Getting quotas for user b5dec80a83aa463b99bd298ab09dfbdb and project 66a98614df914018b7ecfb68afb735c0. Resources: {'key_pairs'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:33:13.494507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ac28c4f7-f509-4736-b5ad-dc7d1401d7e0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'create', calling method: .version_select at 0x7f524b451160>, body: {"keypair": {"name": "tempest-keypair-1046237054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ55g3F8aU+HUO72gFdhTkrYb/KuZg5xLe2iL+aLBeQuAetZMywtVngOpzDYCIWHDbJQP0jd+ot9CgBWsV+2Q9/nXdTEs8i4YMuEFBgAmI71HPwntk+bdxo0Z+y3q77pg=="}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:13.508861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-74cb9ea7-9329-4c3c-be51-2be8a3fd6744 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.178296 Jul 07 15:33:13.510024 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 16/31] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:33:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:13.592933 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-ac28c4f7-f509-4736-b5ad-dc7d1401d7e0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Getting quotas for project d2e4afda121042939745304ce6f76a8b. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:33:13.601824 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-ac28c4f7-f509-4736-b5ad-dc7d1401d7e0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Getting quotas for user 2033ad40d45747aa8294e4feb5a6cfe0 and project d2e4afda121042939745304ce6f76a8b. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:33:13.768669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ac28c4f7-f509-4736-b5ad-dc7d1401d7e0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.472647 Jul 07 15:33:13.775710 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 16/32] 10.222.0.25 () {62 vars in 1199 bytes} [Thu Jul 7 15:33:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 474 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 07 15:33:14.580956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-166346892", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "networks": [{"uuid": "1ede4f7f-1113-444d-ac6e-83d7db0edc7e"}]}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:14.637300 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.network.neutron [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] validate_networks() for [('1ede4f7f-1113-444d-ac6e-83d7db0edc7e', None, None, None, None, None)] {{(pid=124719) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:33:17.609906 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-524693cf-3c5e-47d7-b2f5-2bf860402d2f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: .version_select at 0x7f524b41e3a0>, body: {"keypair": {"name": "tempest-keypair-1820827737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOhxoxKsokh4VHiYRUzW0lmuExeA38GELzdSDBQfdJFI18EmkXfdpCeuWDrTsnQmYLjyOSRR4hmtZkAmKfQ1Gmf3NcHzeeu41xTHUxfqi39xZLg1OXCozCJt1YvuG42pA=="}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:17.654244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Flavor limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:33:17.654956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Image limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:33:17.655643 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Flavor pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:33:17.656392 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Image pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:33:17.657155 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:33:17.661790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-524693cf-3c5e-47d7-b2f5-2bf860402d2f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:33:17.671696 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:17.672050 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:17.675082 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-524693cf-3c5e-47d7-b2f5-2bf860402d2f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for user b2e09539caff4d4698cf29c1ea22d365 and project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:33:17.684531 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:17.684531 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:17.808522 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Getting quotas for project b78a55fc7dba4ed5b22675b585cfe3aa. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:33:17.811306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-524693cf-3c5e-47d7-b2f5-2bf860402d2f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.041335 Jul 07 15:33:17.812164 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 17/33] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:33:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:17.820715 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Getting quotas for user 332b1c9c68db4175a1383bb588b5e822 and project b78a55fc7dba4ed5b22675b585cfe3aa. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:33:17.835433 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Going to run 1 instances... {{(pid=124719) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:33:17.838615 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:33:18.086290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-94530bc8-9ffd-4d77-aec2-5e0b82919e66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.575112 Jul 07 15:33:18.086973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 17/34] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:33:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:33:18.097311 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5c54cdcc-372f-4467-b0f7-5cf27c04096b tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:18.098388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5c54cdcc-372f-4467-b0f7-5cf27c04096b tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:18.375618 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-5c54cdcc-372f-4467-b0f7-5cf27c04096b tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:18.404748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5c54cdcc-372f-4467-b0f7-5cf27c04096b tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1214 microversion: 2.1 time: 0.311146 Jul 07 15:33:18.405342 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 18/35] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:18 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1214 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:19.423392 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4b446f54-94bc-47be-99bd-0744d3320ddc tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:19.424412 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4b446f54-94bc-47be-99bd-0744d3320ddc tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:19.662709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4b446f54-94bc-47be-99bd-0744d3320ddc tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:19.668836 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-469026138", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75a15ea6-f7b1-407c-a2e7-8816149570d9"}], "security_groups": [{"name": "tempest-securitygroup--372155528"}], "key_name": "tempest-keypair-920059883", "user_data": "}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:19.689970 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4b446f54-94bc-47be-99bd-0744d3320ddc tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1214 microversion: 2.1 time: 0.271189 Jul 07 15:33:19.695274 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 18/36] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:19 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:20.033694 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] validate_networks() for [('75a15ea6-f7b1-407c-a2e7-8816149570d9', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:33:20.535608 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-481294798", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e12eafaa-cd14-4167-a6ef-a2ef64a70cc9"}], "security_groups": [{"name": "tempest-securitygroup--727369199"}], "key_name": "tempest-keypair-1046237054", "user_data": "}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:20.721312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.network.neutron [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] validate_networks() for [('e12eafaa-cd14-4167-a6ef-a2ef64a70cc9', None, None, None, None, None)] {{(pid=124719) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:33:21.280247 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Flavor limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:33:21.280846 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Image limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:33:21.281678 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Flavor pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:33:21.282113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Image pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:33:21.282688 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:33:21.301422 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:21.307087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:21.307087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:21.307087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:21.381891 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Getting quotas for project d2e4afda121042939745304ce6f76a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:33:21.396853 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Getting quotas for user 2033ad40d45747aa8294e4feb5a6cfe0 and project d2e4afda121042939745304ce6f76a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:33:21.437750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Going to run 1 instances... {{(pid=124719) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:33:21.439955 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:33:21.654868 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e697084d-857c-4dc7-8365-013209d1a913 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.124496 Jul 07 15:33:21.659033 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 19/37] 10.222.0.25 () {62 vars in 1187 bytes} [Thu Jul 7 15:33:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 07 15:33:21.674062 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-568786c1-e21d-44a3-8269-72f1898d041e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:21.675982 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-568786c1-e21d-44a3-8269-72f1898d041e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:21.695378 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-568786c1-e21d-44a3-8269-72f1898d041e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:21.696250 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-568786c1-e21d-44a3-8269-72f1898d041e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:21.697083 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-568786c1-e21d-44a3-8269-72f1898d041e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:21.697848 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-568786c1-e21d-44a3-8269-72f1898d041e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:21.714110 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:33:21.714609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:33:21.715050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:33:21.715469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:33:21.715918 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:33:21.730391 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:21.731110 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:21.734937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:21.740748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:21.792014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Getting quotas for project 66a98614df914018b7ecfb68afb735c0. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:33:21.802283 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Getting quotas for user b5dec80a83aa463b99bd298ab09dfbdb and project 66a98614df914018b7ecfb68afb735c0. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:33:21.824277 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:33:21.827881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:33:21.976662 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-568786c1-e21d-44a3-8269-72f1898d041e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:21.994301 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-568786c1-e21d-44a3-8269-72f1898d041e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1210 microversion: 2.1 time: 0.333956 Jul 07 15:33:21.995079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 20/38] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:21 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1210 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:22.000361 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bdbd33c3-ba14-4c1c-98e7-f06f721b6517 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:22.001398 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bdbd33c3-ba14-4c1c-98e7-f06f721b6517 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:22.065988 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bdbd33c3-ba14-4c1c-98e7-f06f721b6517 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:22.077496 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bdbd33c3-ba14-4c1c-98e7-f06f721b6517 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:22.079972 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bdbd33c3-ba14-4c1c-98e7-f06f721b6517 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:22.083829 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bdbd33c3-ba14-4c1c-98e7-f06f721b6517 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1281 microversion: 2.20 time: 0.087028 Jul 07 15:33:22.087012 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 21/39] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:21 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:22.115618 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2d84f7cc-600b-4077-89d6-27c48f9c732f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.453178 Jul 07 15:33:22.123203 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 19/40] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:33:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:33:22.131418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-61719d03-7560-429b-b1dd-72436ded08d6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:22.132312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-61719d03-7560-429b-b1dd-72436ded08d6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:22.246828 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-61719d03-7560-429b-b1dd-72436ded08d6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:22.254929 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-61719d03-7560-429b-b1dd-72436ded08d6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1236 microversion: 2.1 time: 0.129711 Jul 07 15:33:22.255842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 22/41] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:22 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1236 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:22.402003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-82720523", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac1a0dbf-9ce9-4f3d-9709-351b088f4833"}], "security_groups": [{"name": "tempest-securitygroup--1242836891"}], "key_name": "tempest-keypair-1820827737", "user_data": "}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:22.618323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] validate_networks() for [('ac1a0dbf-9ce9-4f3d-9709-351b088f4833', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:33:23.016883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f199694d-84b0-4785-a9e5-8ce004fc4b3c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:23.017460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f199694d-84b0-4785-a9e5-8ce004fc4b3c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:23.026386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f199694d-84b0-4785-a9e5-8ce004fc4b3c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:23.026866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f199694d-84b0-4785-a9e5-8ce004fc4b3c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:23.029484 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f199694d-84b0-4785-a9e5-8ce004fc4b3c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:23.029484 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f199694d-84b0-4785-a9e5-8ce004fc4b3c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:23.206730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f199694d-84b0-4785-a9e5-8ce004fc4b3c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:23.232602 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f199694d-84b0-4785-a9e5-8ce004fc4b3c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1274 microversion: 2.1 time: 0.219502 Jul 07 15:33:23.233003 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 23/42] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:23 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:23.253102 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8cbf453a-6e21-4c02-a239-f108edbd0499 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:23.264030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8cbf453a-6e21-4c02-a239-f108edbd0499 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:23.387998 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8cbf453a-6e21-4c02-a239-f108edbd0499 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:23.400197 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8cbf453a-6e21-4c02-a239-f108edbd0499 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:23.416073 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8cbf453a-6e21-4c02-a239-f108edbd0499 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:23.419091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8cbf453a-6e21-4c02-a239-f108edbd0499 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1281 microversion: 2.20 time: 0.182032 Jul 07 15:33:23.422666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 24/43] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:23 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:23.438985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-817444f0-a440-454d-9e2c-f6cd3cdf48ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:23.438985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-817444f0-a440-454d-9e2c-f6cd3cdf48ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:23.599166 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-817444f0-a440-454d-9e2c-f6cd3cdf48ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:23.610840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-817444f0-a440-454d-9e2c-f6cd3cdf48ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1236 microversion: 2.1 time: 0.186766 Jul 07 15:33:23.611877 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 25/44] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:23 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1236 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:23.630798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:33:23.632101 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:33:23.632576 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:33:23.632986 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:33:23.633399 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:33:23.647842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:23.651695 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:23.651695 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:23.651695 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:23.679290 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:33:23.683813 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for user b2e09539caff4d4698cf29c1ea22d365 and project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:33:23.698352 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:33:23.701121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:33:23.940447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ba551b10-f139-4dc8-8e87-11976642e158 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.543669 Jul 07 15:33:23.943233 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 20/45] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:33:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:33:23.959753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c5a0f284-9c61-4b89-99b4-065c2c6bfd5b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:23.959753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c5a0f284-9c61-4b89-99b4-065c2c6bfd5b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:24.050606 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c5a0f284-9c61-4b89-99b4-065c2c6bfd5b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:24.061712 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c5a0f284-9c61-4b89-99b4-065c2c6bfd5b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1240 microversion: 2.1 time: 0.112826 Jul 07 15:33:24.064000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 26/46] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:23 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1240 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:24.259334 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d377000d-19dd-4911-ac7f-879e9f76c0cd tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:24.259995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d377000d-19dd-4911-ac7f-879e9f76c0cd tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:24.272821 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d377000d-19dd-4911-ac7f-879e9f76c0cd tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:24.273597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d377000d-19dd-4911-ac7f-879e9f76c0cd tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:24.274796 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d377000d-19dd-4911-ac7f-879e9f76c0cd tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:24.275791 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d377000d-19dd-4911-ac7f-879e9f76c0cd tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:24.441425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:24.442243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:24.454178 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:24.459431 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:24.460436 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:24.461765 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:24.566661 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d377000d-19dd-4911-ac7f-879e9f76c0cd tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:24.587264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d377000d-19dd-4911-ac7f-879e9f76c0cd tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1272 microversion: 2.1 time: 0.339597 Jul 07 15:33:24.588693 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 21/47] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:24 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1272 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:24.629671 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4507c977-3cdb-4c27-bec8-1cfd03edb7ce tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:24.638481 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4507c977-3cdb-4c27-bec8-1cfd03edb7ce tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:24.650246 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:24.659637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:24.661954 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:24.663525 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7fdf92c2-9fe5-48a7-9fc6-2985e200700d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1285 microversion: 2.20 time: 0.226048 Jul 07 15:33:24.664634 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 27/48] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:24 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:33:24.688307 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4507c977-3cdb-4c27-bec8-1cfd03edb7ce tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:24.688762 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4507c977-3cdb-4c27-bec8-1cfd03edb7ce tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:24.692727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4507c977-3cdb-4c27-bec8-1cfd03edb7ce tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:24.699597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4507c977-3cdb-4c27-bec8-1cfd03edb7ce tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:24.937710 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-4507c977-3cdb-4c27-bec8-1cfd03edb7ce tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:24.946998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4507c977-3cdb-4c27-bec8-1cfd03edb7ce tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1232 microversion: 2.1 time: 0.322515 Jul 07 15:33:24.956601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 22/49] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:24 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1232 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:25.084388 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8f8f7f1f-2d2b-4581-a54a-9d1e36a41421 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:25.085588 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8f8f7f1f-2d2b-4581-a54a-9d1e36a41421 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:25.163231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8f8f7f1f-2d2b-4581-a54a-9d1e36a41421 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:25.175873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8f8f7f1f-2d2b-4581-a54a-9d1e36a41421 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1240 microversion: 2.1 time: 0.095846 Jul 07 15:33:25.177526 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 28/50] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:25 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:25.614278 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-27cbe4b7-ec31-4a7e-a602-66614e317939 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:25.621510 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-27cbe4b7-ec31-4a7e-a602-66614e317939 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:25.636961 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-27cbe4b7-ec31-4a7e-a602-66614e317939 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:25.640086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-27cbe4b7-ec31-4a7e-a602-66614e317939 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:25.647346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-27cbe4b7-ec31-4a7e-a602-66614e317939 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:25.647346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-27cbe4b7-ec31-4a7e-a602-66614e317939 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:25.694707 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:25.695349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:25.711032 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:25.711032 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:25.711032 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:25.717666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:25.891608 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:25.911249 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:25.919272 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:25.920600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c03ba783-35c1-4c15-8415-5e21f4f27037 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1333 microversion: 2.20 time: 0.242172 Jul 07 15:33:25.934194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 29/51] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:25 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1333 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:25.976256 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6a0cb52a-5288-4045-88eb-98974c6549e6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:25.977390 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6a0cb52a-5288-4045-88eb-98974c6549e6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:25.997697 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6a0cb52a-5288-4045-88eb-98974c6549e6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:25.998514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6a0cb52a-5288-4045-88eb-98974c6549e6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:25.999666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6a0cb52a-5288-4045-88eb-98974c6549e6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:26.003138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6a0cb52a-5288-4045-88eb-98974c6549e6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:26.087619 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-27cbe4b7-ec31-4a7e-a602-66614e317939 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:26.096706 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-27cbe4b7-ec31-4a7e-a602-66614e317939 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.494037 Jul 07 15:33:26.111303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 23/52] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:25 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:26.130055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6a0cb52a-5288-4045-88eb-98974c6549e6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:26.138815 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6a0cb52a-5288-4045-88eb-98974c6549e6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1288 microversion: 2.1 time: 0.168286 Jul 07 15:33:26.146628 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 30/53] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:25 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1288 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:26.193978 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ce67bd95-a32d-428e-a47e-0eb058f14528 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:26.194775 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ce67bd95-a32d-428e-a47e-0eb058f14528 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:26.201611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ce67bd95-a32d-428e-a47e-0eb058f14528 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:26.203553 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ce67bd95-a32d-428e-a47e-0eb058f14528 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:26.204721 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ce67bd95-a32d-428e-a47e-0eb058f14528 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:26.205428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ce67bd95-a32d-428e-a47e-0eb058f14528 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:26.324190 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ce67bd95-a32d-428e-a47e-0eb058f14528 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:26.348692 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ce67bd95-a32d-428e-a47e-0eb058f14528 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1244 microversion: 2.1 time: 0.158426 Jul 07 15:33:26.349589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 24/54] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:26 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1244 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:26.944337 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:26.949263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:26.962294 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:26.964894 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:26.965873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:26.966317 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.091489 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:27.102259 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:27.103916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:27.105144 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-83936e77-3dff-4175-bacf-e9510c92b721 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1333 microversion: 2.20 time: 0.164991 Jul 07 15:33:27.112777 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 31/55] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:26 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1333 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:27.120169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f70e8064-2c53-48c8-93b5-12e2f7583adb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:27.121657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f70e8064-2c53-48c8-93b5-12e2f7583adb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:27.135097 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f70e8064-2c53-48c8-93b5-12e2f7583adb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:27.135592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f70e8064-2c53-48c8-93b5-12e2f7583adb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.139268 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f70e8064-2c53-48c8-93b5-12e2f7583adb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:27.140150 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f70e8064-2c53-48c8-93b5-12e2f7583adb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.159236 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ab57cab4-12f4-4177-bc27-e9efd7f32e7d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:27.160163 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ab57cab4-12f4-4177-bc27-e9efd7f32e7d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:27.170358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ab57cab4-12f4-4177-bc27-e9efd7f32e7d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:27.182427 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ab57cab4-12f4-4177-bc27-e9efd7f32e7d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.183582 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ab57cab4-12f4-4177-bc27-e9efd7f32e7d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:27.184180 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ab57cab4-12f4-4177-bc27-e9efd7f32e7d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.358126 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ab57cab4-12f4-4177-bc27-e9efd7f32e7d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:27.371831 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ab57cab4-12f4-4177-bc27-e9efd7f32e7d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1296 microversion: 2.1 time: 0.217259 Jul 07 15:33:27.380993 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 32/56] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:27 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:27.387041 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-66297c50-2406-4f52-87d9-9789a7fb473a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:27.387945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-66297c50-2406-4f52-87d9-9789a7fb473a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:27.397536 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-66297c50-2406-4f52-87d9-9789a7fb473a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:27.398054 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-66297c50-2406-4f52-87d9-9789a7fb473a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.399461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-66297c50-2406-4f52-87d9-9789a7fb473a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:27.399994 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-66297c50-2406-4f52-87d9-9789a7fb473a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.448355 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f70e8064-2c53-48c8-93b5-12e2f7583adb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:27.456621 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f70e8064-2c53-48c8-93b5-12e2f7583adb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.341404 Jul 07 15:33:27.463997 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 25/57] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:27 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:27.698778 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-66297c50-2406-4f52-87d9-9789a7fb473a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:27.716624 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-66297c50-2406-4f52-87d9-9789a7fb473a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1244 microversion: 2.1 time: 0.334190 Jul 07 15:33:27.718233 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 33/58] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:27 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1244 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:27.895385 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-3d115f63-4c9d-4c01-a1e8-554b97beb5d1 req-4029ce14-b77f-45e2-bc20-2d7a87dbfd36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d22cdc4-2300-40f3-a8bb-37bf28c95f2c", "tag": "432e625d-c22c-438e-bcbb-5f647e3c8f84"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:27.917572 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-3d115f63-4c9d-4c01-a1e8-554b97beb5d1 req-4029ce14-b77f-45e2-bc20-2d7a87dbfd36 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:27.918635 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-3d115f63-4c9d-4c01-a1e8-554b97beb5d1 req-4029ce14-b77f-45e2-bc20-2d7a87dbfd36 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.952251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-3d115f63-4c9d-4c01-a1e8-554b97beb5d1 req-4029ce14-b77f-45e2-bc20-2d7a87dbfd36 service nova] Creating event network-changed:432e625d-c22c-438e-bcbb-5f647e3c8f84 for instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c on hv-cinder-84130 Jul 07 15:33:27.953447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-3d115f63-4c9d-4c01-a1e8-554b97beb5d1 req-4029ce14-b77f-45e2-bc20-2d7a87dbfd36 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 07 15:33:27.954559 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b780c7f3-9d13-4827-ac8c-05f9cad9133e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:27.954996 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b780c7f3-9d13-4827-ac8c-05f9cad9133e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.955837 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b780c7f3-9d13-4827-ac8c-05f9cad9133e None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:27.956271 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b780c7f3-9d13-4827-ac8c-05f9cad9133e None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:27.969346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.compute.rpcapi [None req-b780c7f3-9d13-4827-ac8c-05f9cad9133e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 07 15:33:27.970609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b780c7f3-9d13-4827-ac8c-05f9cad9133e None None] Releasing lock "compute-rpcapi-router" {{(pid=124720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 07 15:33:27.990010 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b780c7f3-9d13-4827-ac8c-05f9cad9133e None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181053 Jul 07 15:33:27.990822 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 26/59] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:28.124137 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:28.125424 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:28.131845 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:28.134568 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:28.134568 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:28.134568 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:28.209488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:28.221070 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:28.223302 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:28.224521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b05b5305-fc0c-4983-8a26-202a1af456f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1333 microversion: 2.20 time: 0.104540 Jul 07 15:33:28.232052 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 34/60] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:28 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:28.388160 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cd3f694e-d0be-45e7-8123-581a008c845c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:28.388875 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cd3f694e-d0be-45e7-8123-581a008c845c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:28.396064 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd3f694e-d0be-45e7-8123-581a008c845c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:28.396521 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd3f694e-d0be-45e7-8123-581a008c845c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:28.397303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd3f694e-d0be-45e7-8123-581a008c845c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:28.397746 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd3f694e-d0be-45e7-8123-581a008c845c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:28.475036 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-be07ed2b-1bb1-484b-bcbd-df649044289f tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:28.475945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-be07ed2b-1bb1-484b-bcbd-df649044289f tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:28.485102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cd3f694e-d0be-45e7-8123-581a008c845c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:28.486365 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be07ed2b-1bb1-484b-bcbd-df649044289f tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:28.486758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be07ed2b-1bb1-484b-bcbd-df649044289f tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:28.487914 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be07ed2b-1bb1-484b-bcbd-df649044289f tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:28.488368 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be07ed2b-1bb1-484b-bcbd-df649044289f tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:28.494361 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cd3f694e-d0be-45e7-8123-581a008c845c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1296 microversion: 2.1 time: 0.110492 Jul 07 15:33:28.506485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 27/61] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:28 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:28.656143 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-be07ed2b-1bb1-484b-bcbd-df649044289f tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:28.664753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-be07ed2b-1bb1-484b-bcbd-df649044289f tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.194865 Jul 07 15:33:28.667609 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 35/62] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:28 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:28.737264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e5861472-8c57-4b4c-948a-8e6856e61399 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:28.737881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e5861472-8c57-4b4c-948a-8e6856e61399 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:28.755793 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e5861472-8c57-4b4c-948a-8e6856e61399 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:28.755793 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e5861472-8c57-4b4c-948a-8e6856e61399 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:28.756511 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e5861472-8c57-4b4c-948a-8e6856e61399 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:28.756950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e5861472-8c57-4b4c-948a-8e6856e61399 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:28.831004 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e5861472-8c57-4b4c-948a-8e6856e61399 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:28.838736 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e5861472-8c57-4b4c-948a-8e6856e61399 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1236 microversion: 2.1 time: 0.105767 Jul 07 15:33:28.839320 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 28/63] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:28 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:29.252796 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:29.253407 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:29.259444 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:29.259927 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:29.260684 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:29.261115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:29.327494 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:29.337450 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:29.338974 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:29.340109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e17b774a-a830-4197-a3f2-b2fba1ddadd2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1333 microversion: 2.20 time: 0.095828 Jul 07 15:33:29.340660 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 36/64] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:29 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:29.514840 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cd27e354-0b7f-4502-bab0-e8b4aa6966c2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:29.520003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cd27e354-0b7f-4502-bab0-e8b4aa6966c2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:29.524105 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd27e354-0b7f-4502-bab0-e8b4aa6966c2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:29.524589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd27e354-0b7f-4502-bab0-e8b4aa6966c2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:29.525366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd27e354-0b7f-4502-bab0-e8b4aa6966c2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:29.525820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd27e354-0b7f-4502-bab0-e8b4aa6966c2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:29.603069 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cd27e354-0b7f-4502-bab0-e8b4aa6966c2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:29.610995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cd27e354-0b7f-4502-bab0-e8b4aa6966c2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1296 microversion: 2.1 time: 0.100359 Jul 07 15:33:29.612045 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 29/65] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:29 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:29.685521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-24f99cc1-155f-4bc3-9220-cefadd31978e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:29.686920 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-24f99cc1-155f-4bc3-9220-cefadd31978e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:29.697252 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-24f99cc1-155f-4bc3-9220-cefadd31978e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:29.705342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-24f99cc1-155f-4bc3-9220-cefadd31978e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:29.705342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-24f99cc1-155f-4bc3-9220-cefadd31978e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:29.705342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-24f99cc1-155f-4bc3-9220-cefadd31978e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:29.861517 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5c603b53-8308-4388-b40d-11e8fb7078ee tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:29.862299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5c603b53-8308-4388-b40d-11e8fb7078ee tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:29.882582 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-24f99cc1-155f-4bc3-9220-cefadd31978e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:29.886903 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5c603b53-8308-4388-b40d-11e8fb7078ee tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:29.887395 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5c603b53-8308-4388-b40d-11e8fb7078ee tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:29.892264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5c603b53-8308-4388-b40d-11e8fb7078ee tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:29.892264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5c603b53-8308-4388-b40d-11e8fb7078ee tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:29.893260 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-24f99cc1-155f-4bc3-9220-cefadd31978e tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.214494 Jul 07 15:33:29.894993 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 37/66] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:29 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:30.004159 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-5c603b53-8308-4388-b40d-11e8fb7078ee tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:30.015847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5c603b53-8308-4388-b40d-11e8fb7078ee tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1236 microversion: 2.1 time: 0.163581 Jul 07 15:33:30.026170 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 30/67] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:29 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1236 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:30.364337 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:30.365720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:30.389522 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:30.400418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:30.402142 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:30.403896 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:30.404979 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:30.630866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-14486db2-22e8-4301-9979-d3ad205d2b87 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:30.639303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-14486db2-22e8-4301-9979-d3ad205d2b87 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:30.665228 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-14486db2-22e8-4301-9979-d3ad205d2b87 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:30.669704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-14486db2-22e8-4301-9979-d3ad205d2b87 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:30.673594 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-14486db2-22e8-4301-9979-d3ad205d2b87 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:30.674196 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-14486db2-22e8-4301-9979-d3ad205d2b87 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:31.075840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:31.096751 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:31.104281 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:31.105534 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8eb129a6-e259-4ac5-8ec4-b302b485a4f7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1341 microversion: 2.20 time: 0.746463 Jul 07 15:33:31.106358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 38/68] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:30 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1341 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:31.122840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-89a0c779-6441-47f1-89f9-14b485a88cfa tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:31.133912 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-89a0c779-6441-47f1-89f9-14b485a88cfa tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:31.150109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-89a0c779-6441-47f1-89f9-14b485a88cfa tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:31.150946 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-89a0c779-6441-47f1-89f9-14b485a88cfa tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:31.151775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-89a0c779-6441-47f1-89f9-14b485a88cfa tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:31.157686 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-89a0c779-6441-47f1-89f9-14b485a88cfa tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:31.220745 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-14486db2-22e8-4301-9979-d3ad205d2b87 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:31.232919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-14486db2-22e8-4301-9979-d3ad205d2b87 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1296 microversion: 2.1 time: 0.607945 Jul 07 15:33:31.243550 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 31/69] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:30 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1296 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:31.249252 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1452d202-6898-4758-aeec-92fe0250ec49 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:31.250617 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1452d202-6898-4758-aeec-92fe0250ec49 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:31.257456 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1452d202-6898-4758-aeec-92fe0250ec49 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:31.258152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1452d202-6898-4758-aeec-92fe0250ec49 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:31.259084 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1452d202-6898-4758-aeec-92fe0250ec49 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:31.259704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1452d202-6898-4758-aeec-92fe0250ec49 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:31.325129 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=4 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:31.383257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1452d202-6898-4758-aeec-92fe0250ec49 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:31.400105 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1452d202-6898-4758-aeec-92fe0250ec49 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1292 microversion: 2.1 time: 0.154808 Jul 07 15:33:31.409175 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 32/70] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:31 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1292 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:31.471255 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-89a0c779-6441-47f1-89f9-14b485a88cfa tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:31.479943 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-89a0c779-6441-47f1-89f9-14b485a88cfa tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.370812 Jul 07 15:33:31.480872 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 39/71] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:31 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:32.126182 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:32.132489 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:32.132928 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:32.133377 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:32.134144 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:32.134578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:32.275802 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:32.275802 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:32.276080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:32.276080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d0cfe027-cbee-4bcb-9dc5-f9937746fcc7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1339 microversion: 2.20 time: 0.100575 Jul 07 15:33:32.276080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 33/72] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:32 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:33:32.276289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8b4f8ae4-3b62-40f1-bd3e-282dfc234c3a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:32.276289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8b4f8ae4-3b62-40f1-bd3e-282dfc234c3a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:32.284893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8b4f8ae4-3b62-40f1-bd3e-282dfc234c3a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:32.285370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8b4f8ae4-3b62-40f1-bd3e-282dfc234c3a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:32.286182 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8b4f8ae4-3b62-40f1-bd3e-282dfc234c3a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:32.286712 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8b4f8ae4-3b62-40f1-bd3e-282dfc234c3a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:32.361434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8b4f8ae4-3b62-40f1-bd3e-282dfc234c3a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:32.369282 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8b4f8ae4-3b62-40f1-bd3e-282dfc234c3a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1306 microversion: 2.1 time: 0.122638 Jul 07 15:33:32.370047 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 40/73] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:32 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1306 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:32.418436 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1730c479-d57a-4185-bad7-3b9f652593e1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:32.470375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1730c479-d57a-4185-bad7-3b9f652593e1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:32.470375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1730c479-d57a-4185-bad7-3b9f652593e1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:32.470375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1730c479-d57a-4185-bad7-3b9f652593e1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:32.470375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1730c479-d57a-4185-bad7-3b9f652593e1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:32.470711 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1730c479-d57a-4185-bad7-3b9f652593e1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:32.503910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1730c479-d57a-4185-bad7-3b9f652593e1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:32.507457 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f43f9a75-a13e-4308-8286-d287fca5a7c8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:32.508888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f43f9a75-a13e-4308-8286-d287fca5a7c8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:32.517703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f43f9a75-a13e-4308-8286-d287fca5a7c8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:32.518411 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1730c479-d57a-4185-bad7-3b9f652593e1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1292 microversion: 2.1 time: 0.104247 Jul 07 15:33:32.518630 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f43f9a75-a13e-4308-8286-d287fca5a7c8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:32.519496 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 34/74] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:32 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:32.520036 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f43f9a75-a13e-4308-8286-d287fca5a7c8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:32.520834 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f43f9a75-a13e-4308-8286-d287fca5a7c8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:32.682026 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f43f9a75-a13e-4308-8286-d287fca5a7c8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:32.685332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:32.690477 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f43f9a75-a13e-4308-8286-d287fca5a7c8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.189078 Jul 07 15:33:32.691539 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 41/75] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:32 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:33.269030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:33.270375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:33.277097 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:33.277551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:33.278535 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:33.279167 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:33.347211 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:33.357001 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:33.358996 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:33.360194 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3c26f410-6612-48b1-80e0-0687027585d4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1339 microversion: 2.20 time: 0.095517 Jul 07 15:33:33.360774 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 35/76] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:33 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:33.478874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ae904def-7582-4a74-b9ae-c17579665934 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:33.479797 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ae904def-7582-4a74-b9ae-c17579665934 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:33.487149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae904def-7582-4a74-b9ae-c17579665934 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:33.487641 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae904def-7582-4a74-b9ae-c17579665934 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:33.488419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae904def-7582-4a74-b9ae-c17579665934 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:33.488853 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae904def-7582-4a74-b9ae-c17579665934 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:33.537844 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ed4aac9f-b1a8-48bb-af3d-3930384029b7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:33.538590 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ed4aac9f-b1a8-48bb-af3d-3930384029b7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:33.547693 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ed4aac9f-b1a8-48bb-af3d-3930384029b7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:33.548138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ed4aac9f-b1a8-48bb-af3d-3930384029b7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:33.548904 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ed4aac9f-b1a8-48bb-af3d-3930384029b7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:33.549327 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ed4aac9f-b1a8-48bb-af3d-3930384029b7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:33.574153 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ae904def-7582-4a74-b9ae-c17579665934 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:33.582426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ae904def-7582-4a74-b9ae-c17579665934 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1306 microversion: 2.1 time: 0.108148 Jul 07 15:33:33.582997 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 42/77] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:33 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:33.619052 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ed4aac9f-b1a8-48bb-af3d-3930384029b7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:33.627653 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ed4aac9f-b1a8-48bb-af3d-3930384029b7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1292 microversion: 2.1 time: 0.095403 Jul 07 15:33:33.628235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 36/78] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:33 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:33.710010 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9d60b13e-6f35-44a1-8ece-f9219864ca53 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:33.710585 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9d60b13e-6f35-44a1-8ece-f9219864ca53 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:33.717354 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d60b13e-6f35-44a1-8ece-f9219864ca53 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:33.720360 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d60b13e-6f35-44a1-8ece-f9219864ca53 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:33.720360 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d60b13e-6f35-44a1-8ece-f9219864ca53 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:33.720360 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d60b13e-6f35-44a1-8ece-f9219864ca53 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:33.866313 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9d60b13e-6f35-44a1-8ece-f9219864ca53 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:33.874012 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9d60b13e-6f35-44a1-8ece-f9219864ca53 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.168085 Jul 07 15:33:33.875204 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 43/79] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:33 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:34.380031 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:34.380591 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:34.384792 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=22 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:34.391875 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:34.392623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:34.394224 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:34.394817 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:34.401044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:34.466479 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:34.477952 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:34.480108 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:34.481916 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b972cad9-d5f8-4dc9-8d16-72570629884e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1339 microversion: 2.20 time: 0.107108 Jul 07 15:33:34.482527 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 37/80] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:34 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:34.606112 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c59a0bd9-7e8c-492b-8081-a818c717d899 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:34.607609 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c59a0bd9-7e8c-492b-8081-a818c717d899 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:34.620080 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c59a0bd9-7e8c-492b-8081-a818c717d899 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:34.620544 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c59a0bd9-7e8c-492b-8081-a818c717d899 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:34.621341 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c59a0bd9-7e8c-492b-8081-a818c717d899 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:34.621794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c59a0bd9-7e8c-492b-8081-a818c717d899 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:34.645367 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c9d56b41-e81e-4388-a5f3-69371615186b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:34.645998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c9d56b41-e81e-4388-a5f3-69371615186b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:34.661601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:34.668701 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c9d56b41-e81e-4388-a5f3-69371615186b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:34.669630 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c9d56b41-e81e-4388-a5f3-69371615186b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:34.672483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c9d56b41-e81e-4388-a5f3-69371615186b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:34.672483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c9d56b41-e81e-4388-a5f3-69371615186b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:34.728873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c59a0bd9-7e8c-492b-8081-a818c717d899 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:34.739099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c59a0bd9-7e8c-492b-8081-a818c717d899 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1306 microversion: 2.1 time: 0.138007 Jul 07 15:33:34.742072 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 44/81] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:34 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1306 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:34.759916 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c9d56b41-e81e-4388-a5f3-69371615186b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:34.768251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c9d56b41-e81e-4388-a5f3-69371615186b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1292 microversion: 2.1 time: 0.126722 Jul 07 15:33:34.769006 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 38/82] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:34 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:34.892209 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-44f305c4-7563-4a3d-bb46-77de390a8f72 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:34.893737 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-44f305c4-7563-4a3d-bb46-77de390a8f72 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:34.901324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-44f305c4-7563-4a3d-bb46-77de390a8f72 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:34.901772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-44f305c4-7563-4a3d-bb46-77de390a8f72 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:34.902544 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-44f305c4-7563-4a3d-bb46-77de390a8f72 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:34.902976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-44f305c4-7563-4a3d-bb46-77de390a8f72 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:35.040867 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-44f305c4-7563-4a3d-bb46-77de390a8f72 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:35.048480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-44f305c4-7563-4a3d-bb46-77de390a8f72 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.161179 Jul 07 15:33:35.049051 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 45/83] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:34 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:35.503512 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:35.504319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:35.511323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:35.511904 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:35.513003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:35.513533 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:35.611455 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:35.611455 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:35.611945 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:35.611945 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-74d6cd5a-dec1-4a6a-aed1-6c6270ecdc50 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1339 microversion: 2.20 time: 0.097317 Jul 07 15:33:35.611945 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 39/84] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:35 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:35.757397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fcb4c08b-6fdc-4401-916c-eeb7d8a8e4b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:35.758076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fcb4c08b-6fdc-4401-916c-eeb7d8a8e4b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:35.760300 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=30 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:35.765824 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcb4c08b-6fdc-4401-916c-eeb7d8a8e4b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:35.766339 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcb4c08b-6fdc-4401-916c-eeb7d8a8e4b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:35.767328 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcb4c08b-6fdc-4401-916c-eeb7d8a8e4b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:35.767854 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcb4c08b-6fdc-4401-916c-eeb7d8a8e4b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:35.787448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-96b88a79-db94-4089-ba15-e20bb41e1103 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:35.788412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-96b88a79-db94-4089-ba15-e20bb41e1103 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:35.794775 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-96b88a79-db94-4089-ba15-e20bb41e1103 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:35.795509 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-96b88a79-db94-4089-ba15-e20bb41e1103 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:35.797260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-96b88a79-db94-4089-ba15-e20bb41e1103 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:35.797890 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-96b88a79-db94-4089-ba15-e20bb41e1103 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:35.854532 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-fcb4c08b-6fdc-4401-916c-eeb7d8a8e4b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:35.863558 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fcb4c08b-6fdc-4401-916c-eeb7d8a8e4b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1306 microversion: 2.1 time: 0.110161 Jul 07 15:33:35.864522 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 46/85] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:35 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1306 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:35.876203 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-96b88a79-db94-4089-ba15-e20bb41e1103 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:35.884119 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-96b88a79-db94-4089-ba15-e20bb41e1103 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1292 microversion: 2.1 time: 0.100679 Jul 07 15:33:35.884934 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 40/86] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:35 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:36.065640 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-85d1ea4d-2416-4f6a-8f02-db6c6e5e7b66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:36.066198 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-85d1ea4d-2416-4f6a-8f02-db6c6e5e7b66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:36.073043 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-85d1ea4d-2416-4f6a-8f02-db6c6e5e7b66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:36.073501 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-85d1ea4d-2416-4f6a-8f02-db6c6e5e7b66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:36.074272 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-85d1ea4d-2416-4f6a-8f02-db6c6e5e7b66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:36.074708 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-85d1ea4d-2416-4f6a-8f02-db6c6e5e7b66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:36.210645 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-85d1ea4d-2416-4f6a-8f02-db6c6e5e7b66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:36.218563 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-85d1ea4d-2416-4f6a-8f02-db6c6e5e7b66 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.156812 Jul 07 15:33:36.219136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 47/87] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:36 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:36.613431 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:36.613978 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:36.620037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:36.620483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:36.621234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:36.621962 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:36.685503 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:36.693625 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:36.695123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:36.696260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-33aff6b7-0b04-4d84-bb49-93e2dcc6b2a3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1339 microversion: 2.20 time: 0.087752 Jul 07 15:33:36.696809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 41/88] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:36 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:36.882027 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-55f97fac-e2e3-4b4e-b931-814f203b17b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:36.882564 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-55f97fac-e2e3-4b4e-b931-814f203b17b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:36.889044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-55f97fac-e2e3-4b4e-b931-814f203b17b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:36.889483 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-55f97fac-e2e3-4b4e-b931-814f203b17b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:36.890744 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-55f97fac-e2e3-4b4e-b931-814f203b17b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:36.891212 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-55f97fac-e2e3-4b4e-b931-814f203b17b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:36.901094 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6f7599c4-c178-48de-9f32-5ba839545607 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:36.914071 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6f7599c4-c178-48de-9f32-5ba839545607 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:36.914071 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6f7599c4-c178-48de-9f32-5ba839545607 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:36.914071 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6f7599c4-c178-48de-9f32-5ba839545607 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:36.914071 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6f7599c4-c178-48de-9f32-5ba839545607 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:36.914402 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6f7599c4-c178-48de-9f32-5ba839545607 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:36.954924 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-55f97fac-e2e3-4b4e-b931-814f203b17b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:36.962478 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-55f97fac-e2e3-4b4e-b931-814f203b17b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1306 microversion: 2.1 time: 0.084483 Jul 07 15:33:36.963264 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 48/89] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:36 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:36.988655 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6f7599c4-c178-48de-9f32-5ba839545607 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:36.996245 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6f7599c4-c178-48de-9f32-5ba839545607 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1292 microversion: 2.1 time: 0.098981 Jul 07 15:33:36.996823 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 42/90] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:36 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:37.241691 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-487aa6ca-04c0-4de4-961b-8ebcee5107f4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:37.242304 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-487aa6ca-04c0-4de4-961b-8ebcee5107f4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:37.248172 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-487aa6ca-04c0-4de4-961b-8ebcee5107f4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:37.248613 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-487aa6ca-04c0-4de4-961b-8ebcee5107f4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:37.249874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-487aa6ca-04c0-4de4-961b-8ebcee5107f4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:37.250300 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-487aa6ca-04c0-4de4-961b-8ebcee5107f4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:37.384804 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-487aa6ca-04c0-4de4-961b-8ebcee5107f4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:37.393407 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-487aa6ca-04c0-4de4-961b-8ebcee5107f4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.155427 Jul 07 15:33:37.394043 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 49/91] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:37 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:37.713911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:37.716437 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:37.722628 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:37.723075 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:37.723868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:37.724447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:37.785457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:37.793513 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:37.795103 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:37.797186 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9a3beb8c-4077-44d5-9c4e-36b7da2f6a23 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1339 microversion: 2.20 time: 0.087110 Jul 07 15:33:37.797742 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 43/92] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:37 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:37.980089 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-74a2f951-cf37-4198-b775-e5f4a40865b9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:37.981337 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-74a2f951-cf37-4198-b775-e5f4a40865b9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:37.988067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-74a2f951-cf37-4198-b775-e5f4a40865b9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:37.992142 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-74a2f951-cf37-4198-b775-e5f4a40865b9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:37.992142 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-74a2f951-cf37-4198-b775-e5f4a40865b9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:37.992142 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-74a2f951-cf37-4198-b775-e5f4a40865b9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:38.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fae62f4d-0e5d-4f54-9638-814932de79a7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:38.013104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fae62f4d-0e5d-4f54-9638-814932de79a7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:38.018466 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=6 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:38.020155 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fae62f4d-0e5d-4f54-9638-814932de79a7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:38.020795 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fae62f4d-0e5d-4f54-9638-814932de79a7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:38.021675 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fae62f4d-0e5d-4f54-9638-814932de79a7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:38.022102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fae62f4d-0e5d-4f54-9638-814932de79a7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:38.055579 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-74a2f951-cf37-4198-b775-e5f4a40865b9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:38.060584 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-74a2f951-cf37-4198-b775-e5f4a40865b9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1306 microversion: 2.1 time: 0.084298 Jul 07 15:33:38.061358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 50/93] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:37 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:38.089169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fae62f4d-0e5d-4f54-9638-814932de79a7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:38.097158 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fae62f4d-0e5d-4f54-9638-814932de79a7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1292 microversion: 2.1 time: 0.088772 Jul 07 15:33:38.097723 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 44/94] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:38 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:38.412222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cafc83b6-cb26-4bd3-84e5-b01c1e294cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:38.413353 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cafc83b6-cb26-4bd3-84e5-b01c1e294cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:38.423382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cafc83b6-cb26-4bd3-84e5-b01c1e294cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:38.423382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cafc83b6-cb26-4bd3-84e5-b01c1e294cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:38.423382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cafc83b6-cb26-4bd3-84e5-b01c1e294cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:38.423382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cafc83b6-cb26-4bd3-84e5-b01c1e294cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:38.817439 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:38.819729 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:38.835723 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:38.836569 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:38.837505 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:38.838112 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:38.938440 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:38.957526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:38.959100 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:38.960252 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-04cf7bd6-b95c-4be7-837e-bcedef02a241 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1339 microversion: 2.20 time: 0.149737 Jul 07 15:33:38.971584 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 45/95] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:38 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1339 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:38.983879 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cafc83b6-cb26-4bd3-84e5-b01c1e294cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:38.992715 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cafc83b6-cb26-4bd3-84e5-b01c1e294cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.585642 Jul 07 15:33:38.993930 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 51/96] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:38 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:39.086627 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-617231a6-cf69-474c-96d5-39c12580ab2c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:39.086627 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-617231a6-cf69-474c-96d5-39c12580ab2c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:39.094924 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-617231a6-cf69-474c-96d5-39c12580ab2c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:39.095719 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-617231a6-cf69-474c-96d5-39c12580ab2c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:39.096980 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-617231a6-cf69-474c-96d5-39c12580ab2c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:39.097572 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-617231a6-cf69-474c-96d5-39c12580ab2c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:39.114400 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-715b76cc-add4-4e25-8fe1-3e35b752d939 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:39.115269 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-715b76cc-add4-4e25-8fe1-3e35b752d939 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:39.122505 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-715b76cc-add4-4e25-8fe1-3e35b752d939 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:39.123190 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-715b76cc-add4-4e25-8fe1-3e35b752d939 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:39.124804 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-715b76cc-add4-4e25-8fe1-3e35b752d939 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:39.132277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-715b76cc-add4-4e25-8fe1-3e35b752d939 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:39.270789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-617231a6-cf69-474c-96d5-39c12580ab2c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:39.278109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-617231a6-cf69-474c-96d5-39c12580ab2c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1294 microversion: 2.1 time: 0.204069 Jul 07 15:33:39.278673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 46/97] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:39 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1294 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:39.305788 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-715b76cc-add4-4e25-8fe1-3e35b752d939 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:39.309722 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-715b76cc-add4-4e25-8fe1-3e35b752d939 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1310 microversion: 2.1 time: 0.197288 Jul 07 15:33:39.320883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 52/98] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:39 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1310 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:39.981396 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:39.985169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:39.993726 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:39.994166 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:39.994939 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:39.995366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:40.011648 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a3f58938-e1be-4156-a209-4b5d4a06575d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:40.012259 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a3f58938-e1be-4156-a209-4b5d4a06575d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:40.025369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a3f58938-e1be-4156-a209-4b5d4a06575d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:40.025369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a3f58938-e1be-4156-a209-4b5d4a06575d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:40.025369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a3f58938-e1be-4156-a209-4b5d4a06575d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:40.025369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a3f58938-e1be-4156-a209-4b5d4a06575d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:40.147832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:40.177480 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:40.177480 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:40.177480 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1d85c43b-4887-4b90-a75c-472a38d1d319 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1339 microversion: 2.20 time: 0.192537 Jul 07 15:33:40.178539 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 47/99] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:39 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1339 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:40.266231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a3f58938-e1be-4156-a209-4b5d4a06575d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:40.281472 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a3f58938-e1be-4156-a209-4b5d4a06575d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.273800 Jul 07 15:33:40.283144 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 53/100] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:40 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:40.297217 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2d4bb6f2-0265-47e9-973b-eb838238f023 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:40.297832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2d4bb6f2-0265-47e9-973b-eb838238f023 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:40.313344 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2d4bb6f2-0265-47e9-973b-eb838238f023 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:40.313344 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2d4bb6f2-0265-47e9-973b-eb838238f023 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:40.313344 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2d4bb6f2-0265-47e9-973b-eb838238f023 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:40.313344 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2d4bb6f2-0265-47e9-973b-eb838238f023 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:40.331647 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ae46eff1-8460-4798-bed7-cdf331396c25 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:40.335505 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ae46eff1-8460-4798-bed7-cdf331396c25 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:40.349694 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae46eff1-8460-4798-bed7-cdf331396c25 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:40.350425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae46eff1-8460-4798-bed7-cdf331396c25 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:40.353214 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae46eff1-8460-4798-bed7-cdf331396c25 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:40.356853 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae46eff1-8460-4798-bed7-cdf331396c25 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:40.781351 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2d4bb6f2-0265-47e9-973b-eb838238f023 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:40.788926 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2d4bb6f2-0265-47e9-973b-eb838238f023 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.496049 Jul 07 15:33:40.789498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 48/101] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:40 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:40.793264 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ae46eff1-8460-4798-bed7-cdf331396c25 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:40.801333 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ae46eff1-8460-4798-bed7-cdf331396c25 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.477070 Jul 07 15:33:40.801944 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 54/102] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:40 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:41.183882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:41.184475 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:41.190459 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:41.190906 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:41.191764 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:41.192215 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:41.299628 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fe4ddf48-fb8c-4d66-bea1-5767367e2415 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:41.301476 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fe4ddf48-fb8c-4d66-bea1-5767367e2415 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:41.311977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fe4ddf48-fb8c-4d66-bea1-5767367e2415 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:41.312965 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fe4ddf48-fb8c-4d66-bea1-5767367e2415 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:41.314109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fe4ddf48-fb8c-4d66-bea1-5767367e2415 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:41.315034 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fe4ddf48-fb8c-4d66-bea1-5767367e2415 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:41.503370 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:41.511510 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:41.513049 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:41.514154 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3267c2a0-780c-4739-8b11-d819732a7e3e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.334282 Jul 07 15:33:41.527727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 49/103] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:41 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:41.721612 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-fe4ddf48-fb8c-4d66-bea1-5767367e2415 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:41.732650 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fe4ddf48-fb8c-4d66-bea1-5767367e2415 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.437505 Jul 07 15:33:41.736896 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 55/104] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:41 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:41.806284 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fe3ba4ae-5793-4d8b-b84e-f0a2841066f6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:41.806884 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fe3ba4ae-5793-4d8b-b84e-f0a2841066f6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:41.819973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f41798dc-72d6-481f-a9ff-6a4c539d07a6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:41.820572 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f41798dc-72d6-481f-a9ff-6a4c539d07a6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:41.825696 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fe3ba4ae-5793-4d8b-b84e-f0a2841066f6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:41.826388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fe3ba4ae-5793-4d8b-b84e-f0a2841066f6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:41.828882 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f41798dc-72d6-481f-a9ff-6a4c539d07a6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:41.829882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fe3ba4ae-5793-4d8b-b84e-f0a2841066f6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:41.830461 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fe3ba4ae-5793-4d8b-b84e-f0a2841066f6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:41.832312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f41798dc-72d6-481f-a9ff-6a4c539d07a6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:41.835117 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f41798dc-72d6-481f-a9ff-6a4c539d07a6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:41.835815 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f41798dc-72d6-481f-a9ff-6a4c539d07a6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:42.182770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fe3ba4ae-5793-4d8b-b84e-f0a2841066f6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:42.190925 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fe3ba4ae-5793-4d8b-b84e-f0a2841066f6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.388478 Jul 07 15:33:42.199916 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 50/105] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:41 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:42.242018 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f41798dc-72d6-481f-a9ff-6a4c539d07a6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:42.251346 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f41798dc-72d6-481f-a9ff-6a4c539d07a6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.435192 Jul 07 15:33:42.255190 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 56/106] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:41 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:42.539819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:42.540441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:42.547525 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:42.548285 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:42.549398 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:42.549991 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:42.750520 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-095cc5f6-e58e-450f-8285-54c84ffdbb97 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:42.751912 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-095cc5f6-e58e-450f-8285-54c84ffdbb97 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:42.759464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-095cc5f6-e58e-450f-8285-54c84ffdbb97 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:42.760006 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-095cc5f6-e58e-450f-8285-54c84ffdbb97 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:42.773890 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-095cc5f6-e58e-450f-8285-54c84ffdbb97 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:42.775357 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-095cc5f6-e58e-450f-8285-54c84ffdbb97 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:42.878444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:42.888150 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:42.890835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:42.892172 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3986ea05-0264-455b-af67-20d870ece975 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.356399 Jul 07 15:33:42.893455 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 51/107] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:42 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:42.994601 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-095cc5f6-e58e-450f-8285-54c84ffdbb97 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:43.002302 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-095cc5f6-e58e-450f-8285-54c84ffdbb97 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.256040 Jul 07 15:33:43.003008 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 57/108] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:42 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:43.028845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-919cbeff-cff0-4e26-a905-9651a9edd072 req-abb3fd0f-debc-4517-99ee-0f81fad8e861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e85e6b3-ebad-441e-afcd-31692b27b782", "tag": "8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:43.036495 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-919cbeff-cff0-4e26-a905-9651a9edd072 req-abb3fd0f-debc-4517-99ee-0f81fad8e861 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.037104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-919cbeff-cff0-4e26-a905-9651a9edd072 req-abb3fd0f-debc-4517-99ee-0f81fad8e861 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.050918 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-919cbeff-cff0-4e26-a905-9651a9edd072 req-abb3fd0f-debc-4517-99ee-0f81fad8e861 service nova] Creating event network-changed:8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a for instance 2e85e6b3-ebad-441e-afcd-31692b27b782 on hv-cinder-84130 Jul 07 15:33:43.056259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-919cbeff-cff0-4e26-a905-9651a9edd072 req-abb3fd0f-debc-4517-99ee-0f81fad8e861 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119568 Jul 07 15:33:43.057333 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 52/109] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:33:43.078101 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-1b7717df-cae7-49f2-8852-a3b564e6691b req-2f48fb45-9bf3-410d-96fd-e1ed67414d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5788db1-1101-4334-abdd-2f11d074751a", "tag": "647ad2af-c816-4ebc-a882-af1290b500a2"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:43.092353 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-1b7717df-cae7-49f2-8852-a3b564e6691b req-2f48fb45-9bf3-410d-96fd-e1ed67414d84 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.092870 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-1b7717df-cae7-49f2-8852-a3b564e6691b req-2f48fb45-9bf3-410d-96fd-e1ed67414d84 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.122577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-1b7717df-cae7-49f2-8852-a3b564e6691b req-2f48fb45-9bf3-410d-96fd-e1ed67414d84 service nova] Creating event network-changed:647ad2af-c816-4ebc-a882-af1290b500a2 for instance a5788db1-1101-4334-abdd-2f11d074751a on hv-cinder-84130 Jul 07 15:33:43.123131 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-1b7717df-cae7-49f2-8852-a3b564e6691b req-2f48fb45-9bf3-410d-96fd-e1ed67414d84 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 07 15:33:43.125399 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f89bf854-068e-4ef7-aa5d-83a13da5343e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.126277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f89bf854-068e-4ef7-aa5d-83a13da5343e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.127705 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f89bf854-068e-4ef7-aa5d-83a13da5343e None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.128293 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f89bf854-068e-4ef7-aa5d-83a13da5343e None None] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.136290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:43.140086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.compute.rpcapi [None req-f89bf854-068e-4ef7-aa5d-83a13da5343e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 07 15:33:43.140980 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f89bf854-068e-4ef7-aa5d-83a13da5343e None None] Releasing lock "compute-rpcapi-router" {{(pid=124719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 07 15:33:43.157087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f89bf854-068e-4ef7-aa5d-83a13da5343e None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083425 Jul 07 15:33:43.158161 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 58/110] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:43.209905 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-75b3e434-617a-467c-8173-b5f2e403f231 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:43.210697 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-75b3e434-617a-467c-8173-b5f2e403f231 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:43.222241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-75b3e434-617a-467c-8173-b5f2e403f231 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.223886 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-75b3e434-617a-467c-8173-b5f2e403f231 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.224951 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-75b3e434-617a-467c-8173-b5f2e403f231 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.225596 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-75b3e434-617a-467c-8173-b5f2e403f231 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.273078 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a9945b0b-6b83-4371-9280-9927ca739baa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:43.274185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a9945b0b-6b83-4371-9280-9927ca739baa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:43.281712 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9945b0b-6b83-4371-9280-9927ca739baa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.282307 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9945b0b-6b83-4371-9280-9927ca739baa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.283239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9945b0b-6b83-4371-9280-9927ca739baa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.283833 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9945b0b-6b83-4371-9280-9927ca739baa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.445148 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-75b3e434-617a-467c-8173-b5f2e403f231 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:43.455397 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-75b3e434-617a-467c-8173-b5f2e403f231 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.250268 Jul 07 15:33:43.456561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 53/111] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:43 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:43.492636 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a9945b0b-6b83-4371-9280-9927ca739baa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:43.500484 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a9945b0b-6b83-4371-9280-9927ca739baa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.232390 Jul 07 15:33:43.501249 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 59/112] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:43 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:43.910799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:43.911387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:43.917879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.918321 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.919069 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:43.919494 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:43.937807 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:44.020723 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-37329607-26ad-4a0e-b394-c19883eb7779 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:44.021331 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-37329607-26ad-4a0e-b394-c19883eb7779 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:44.027623 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-37329607-26ad-4a0e-b394-c19883eb7779 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:44.028068 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-37329607-26ad-4a0e-b394-c19883eb7779 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:44.028874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-37329607-26ad-4a0e-b394-c19883eb7779 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:44.029302 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-37329607-26ad-4a0e-b394-c19883eb7779 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:44.051627 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:44.065677 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:44.067169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:44.068350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-280b05c4-8b11-4836-b784-86ea1b954c42 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.161556 Jul 07 15:33:44.069981 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 54/113] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:43 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:44.185073 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-37329607-26ad-4a0e-b394-c19883eb7779 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:44.194083 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-37329607-26ad-4a0e-b394-c19883eb7779 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.177905 Jul 07 15:33:44.195164 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 60/114] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:44 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:44.472975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cd7943c9-3c89-41af-a25c-78ecb261341c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:44.473577 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cd7943c9-3c89-41af-a25c-78ecb261341c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:44.479955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd7943c9-3c89-41af-a25c-78ecb261341c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:44.480925 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd7943c9-3c89-41af-a25c-78ecb261341c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:44.481802 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd7943c9-3c89-41af-a25c-78ecb261341c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:44.482234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd7943c9-3c89-41af-a25c-78ecb261341c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:44.516975 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-44a4e115-636d-4229-bd41-59250d8b9880 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:44.517582 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-44a4e115-636d-4229-bd41-59250d8b9880 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:44.523770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-44a4e115-636d-4229-bd41-59250d8b9880 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:44.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-44a4e115-636d-4229-bd41-59250d8b9880 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:44.525230 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-44a4e115-636d-4229-bd41-59250d8b9880 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:44.525660 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-44a4e115-636d-4229-bd41-59250d8b9880 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:44.672383 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cd7943c9-3c89-41af-a25c-78ecb261341c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:44.680119 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cd7943c9-3c89-41af-a25c-78ecb261341c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.211622 Jul 07 15:33:44.680757 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 55/115] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:44 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:44.704706 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-44a4e115-636d-4229-bd41-59250d8b9880 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:44.722309 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-44a4e115-636d-4229-bd41-59250d8b9880 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.208972 Jul 07 15:33:44.722902 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 61/116] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:44 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:45.093215 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:45.096257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:45.157662 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:45.159693 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:45.162153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:45.165003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:45.202403 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-4a346cc4-f126-4274-8a3d-ce08d21c6555 req-d2492c45-50d3-4108-9d58-f5f18711d758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1ae649-fd9a-4dcd-ae5a-384e324e4de9", "tag": "81cf072b-a045-4379-a583-082f35faaaf6"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:45.228606 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-4a346cc4-f126-4274-8a3d-ce08d21c6555 req-d2492c45-50d3-4108-9d58-f5f18711d758 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:45.228606 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-4a346cc4-f126-4274-8a3d-ce08d21c6555 req-d2492c45-50d3-4108-9d58-f5f18711d758 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:45.243730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-4a346cc4-f126-4274-8a3d-ce08d21c6555 req-d2492c45-50d3-4108-9d58-f5f18711d758 service nova] Creating event network-changed:81cf072b-a045-4379-a583-082f35faaaf6 for instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 on hv-cinder-84130 Jul 07 15:33:45.254584 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-4a346cc4-f126-4274-8a3d-ce08d21c6555 req-d2492c45-50d3-4108-9d58-f5f18711d758 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056605 Jul 07 15:33:45.255883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 62/117] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:33:45.261659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5f854ab4-b0d9-4018-9c4f-7dbb3d750b14 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:45.262585 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5f854ab4-b0d9-4018-9c4f-7dbb3d750b14 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:45.269628 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f854ab4-b0d9-4018-9c4f-7dbb3d750b14 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:45.271040 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f854ab4-b0d9-4018-9c4f-7dbb3d750b14 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:45.272217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f854ab4-b0d9-4018-9c4f-7dbb3d750b14 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:45.272809 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f854ab4-b0d9-4018-9c4f-7dbb3d750b14 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:45.495126 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:45.504630 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:45.506265 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:45.508102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e0a482bb-07bc-4687-857b-82218d4ce74e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.420053 Jul 07 15:33:45.508403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 56/118] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:45 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:45.558054 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5f854ab4-b0d9-4018-9c4f-7dbb3d750b14 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:45.577546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5f854ab4-b0d9-4018-9c4f-7dbb3d750b14 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.319160 Jul 07 15:33:45.578387 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 63/119] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:45 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:45.699936 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3be3f574-2e11-4eb1-9255-8556d32e5f9d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:45.700540 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3be3f574-2e11-4eb1-9255-8556d32e5f9d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:45.707212 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3be3f574-2e11-4eb1-9255-8556d32e5f9d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:45.707698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3be3f574-2e11-4eb1-9255-8556d32e5f9d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:45.708457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3be3f574-2e11-4eb1-9255-8556d32e5f9d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:45.708893 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3be3f574-2e11-4eb1-9255-8556d32e5f9d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:45.740137 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a2e33844-3aba-4423-9419-0a3c184504fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:45.741008 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a2e33844-3aba-4423-9419-0a3c184504fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:45.751720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a2e33844-3aba-4423-9419-0a3c184504fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:45.752495 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a2e33844-3aba-4423-9419-0a3c184504fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:45.753611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a2e33844-3aba-4423-9419-0a3c184504fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:45.754164 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a2e33844-3aba-4423-9419-0a3c184504fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:45.915842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3be3f574-2e11-4eb1-9255-8556d32e5f9d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:45.925387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3be3f574-2e11-4eb1-9255-8556d32e5f9d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.229223 Jul 07 15:33:45.942273 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 57/120] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:45 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:45.953175 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a2e33844-3aba-4423-9419-0a3c184504fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:45.962077 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a2e33844-3aba-4423-9419-0a3c184504fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.225777 Jul 07 15:33:45.962766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 64/121] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:45 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:46.529178 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:46.531115 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:46.541323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:46.541812 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:46.542792 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:46.543435 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:46.594936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a4ec10f8-2b2c-48f1-ab9c-ded96d4c0cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:46.596378 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a4ec10f8-2b2c-48f1-ab9c-ded96d4c0cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:46.612063 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4ec10f8-2b2c-48f1-ab9c-ded96d4c0cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:46.612751 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4ec10f8-2b2c-48f1-ab9c-ded96d4c0cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:46.616598 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4ec10f8-2b2c-48f1-ab9c-ded96d4c0cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:46.621602 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4ec10f8-2b2c-48f1-ab9c-ded96d4c0cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:47.359398 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:47.369665 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:47.372390 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:47.375590 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-28953929-b4f3-49f0-9726-91b0cb1abdaf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.851056 Jul 07 15:33:47.381929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 58/122] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:46 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:47.384221 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-368b369a-d2c0-4317-9025-888be11fce92 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:47.385165 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-368b369a-d2c0-4317-9025-888be11fce92 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:47.392053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a4ec10f8-2b2c-48f1-ab9c-ded96d4c0cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:47.395157 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-368b369a-d2c0-4317-9025-888be11fce92 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:47.395873 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-368b369a-d2c0-4317-9025-888be11fce92 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:47.396856 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-368b369a-d2c0-4317-9025-888be11fce92 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:47.397782 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-368b369a-d2c0-4317-9025-888be11fce92 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:47.410805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a4ec10f8-2b2c-48f1-ab9c-ded96d4c0cd1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.819562 Jul 07 15:33:47.411115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 65/123] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:46 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:47.425323 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-54177a2a-b21b-486b-a876-4fb1b71425a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:47.426122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-54177a2a-b21b-486b-a876-4fb1b71425a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:47.435703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54177a2a-b21b-486b-a876-4fb1b71425a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:47.436790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54177a2a-b21b-486b-a876-4fb1b71425a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:47.437592 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54177a2a-b21b-486b-a876-4fb1b71425a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:47.438028 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54177a2a-b21b-486b-a876-4fb1b71425a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:47.660314 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-368b369a-d2c0-4317-9025-888be11fce92 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:47.669252 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-368b369a-d2c0-4317-9025-888be11fce92 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.290569 Jul 07 15:33:47.670147 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 59/124] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:47 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:47.687438 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-54177a2a-b21b-486b-a876-4fb1b71425a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:47.695106 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-54177a2a-b21b-486b-a876-4fb1b71425a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.282920 Jul 07 15:33:47.695729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 66/125] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:47 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:47.819807 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-37bf011f-b9e2-4a8f-9f15-e7dfc0acf0d0 req-f56a795f-30e0-4c88-b725-9c127cb3ca7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d22cdc4-2300-40f3-a8bb-37bf28c95f2c", "name": "network-vif-plugged", "status": "completed", "tag": "432e625d-c22c-438e-bcbb-5f647e3c8f84"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:47.828055 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-37bf011f-b9e2-4a8f-9f15-e7dfc0acf0d0 req-f56a795f-30e0-4c88-b725-9c127cb3ca7e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:47.828494 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-37bf011f-b9e2-4a8f-9f15-e7dfc0acf0d0 req-f56a795f-30e0-4c88-b725-9c127cb3ca7e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:47.839823 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-37bf011f-b9e2-4a8f-9f15-e7dfc0acf0d0 req-f56a795f-30e0-4c88-b725-9c127cb3ca7e service nova] Creating event network-vif-plugged:432e625d-c22c-438e-bcbb-5f647e3c8f84 for instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c on hv-cinder-84130 Jul 07 15:33:47.845638 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-37bf011f-b9e2-4a8f-9f15-e7dfc0acf0d0 req-f56a795f-30e0-4c88-b725-9c127cb3ca7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173525 Jul 07 15:33:47.846274 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 60/126] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:48.398422 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:48.399358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:48.410988 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:48.411740 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:48.412831 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:48.413574 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:48.430253 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fa9b74c0-6194-4970-a8b5-bc4c2eeaf3ab tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:48.431558 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fa9b74c0-6194-4970-a8b5-bc4c2eeaf3ab tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:48.446523 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa9b74c0-6194-4970-a8b5-bc4c2eeaf3ab tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:48.446974 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa9b74c0-6194-4970-a8b5-bc4c2eeaf3ab tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:48.447778 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa9b74c0-6194-4970-a8b5-bc4c2eeaf3ab tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:48.448210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa9b74c0-6194-4970-a8b5-bc4c2eeaf3ab tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:48.642725 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:48.652006 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:48.653841 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:48.657054 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f490e6cd-0a87-4883-a67a-c273e24baa82 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.266304 Jul 07 15:33:48.668377 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fa9b74c0-6194-4970-a8b5-bc4c2eeaf3ab tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:48.669560 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 67/127] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:48 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:48.675865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fa9b74c0-6194-4970-a8b5-bc4c2eeaf3ab tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.252281 Jul 07 15:33:48.676545 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 61/128] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:48 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:48.686606 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f214a848-eed6-4b04-a582-32c523708b20 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:48.687460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f214a848-eed6-4b04-a582-32c523708b20 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:48.694280 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f214a848-eed6-4b04-a582-32c523708b20 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:48.694693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f214a848-eed6-4b04-a582-32c523708b20 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:48.695459 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f214a848-eed6-4b04-a582-32c523708b20 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:48.695934 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f214a848-eed6-4b04-a582-32c523708b20 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:48.713226 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-17dbb4ad-cf16-4573-873b-97355ebac54e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:48.715039 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-17dbb4ad-cf16-4573-873b-97355ebac54e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:48.723160 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-17dbb4ad-cf16-4573-873b-97355ebac54e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:48.723772 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-17dbb4ad-cf16-4573-873b-97355ebac54e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:48.725140 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-17dbb4ad-cf16-4573-873b-97355ebac54e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:48.725660 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-17dbb4ad-cf16-4573-873b-97355ebac54e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:48.903987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f214a848-eed6-4b04-a582-32c523708b20 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:48.907601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-17dbb4ad-cf16-4573-873b-97355ebac54e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:48.912303 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f214a848-eed6-4b04-a582-32c523708b20 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.230007 Jul 07 15:33:48.912871 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 68/129] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:48 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:48.915646 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-17dbb4ad-cf16-4573-873b-97355ebac54e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.206556 Jul 07 15:33:48.916107 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 62/130] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:48 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:49.676296 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:49.676936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:49.683229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:49.683706 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:49.684459 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:49.684899 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:49.695024 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d7e17311-6bc5-4fbf-8672-7b5026ed1cf5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:49.695669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d7e17311-6bc5-4fbf-8672-7b5026ed1cf5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:49.702007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d7e17311-6bc5-4fbf-8672-7b5026ed1cf5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:49.703070 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d7e17311-6bc5-4fbf-8672-7b5026ed1cf5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:49.704533 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d7e17311-6bc5-4fbf-8672-7b5026ed1cf5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:49.704972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d7e17311-6bc5-4fbf-8672-7b5026ed1cf5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:49.904171 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:49.907818 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d7e17311-6bc5-4fbf-8672-7b5026ed1cf5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:49.913639 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:49.915196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:49.915677 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d7e17311-6bc5-4fbf-8672-7b5026ed1cf5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.225963 Jul 07 15:33:49.916249 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 63/131] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:49 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:49.916616 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-85da4e8d-7992-4626-9ed3-d581a4f20642 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.244157 Jul 07 15:33:49.919533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 69/132] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:49 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:49.932488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-039195eb-efb1-4734-a183-f6fedd1eaf3d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:49.933092 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-039195eb-efb1-4734-a183-f6fedd1eaf3d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:49.935467 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9921a314-c92a-4831-9862-a69c2fc89b57 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:49.936407 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9921a314-c92a-4831-9862-a69c2fc89b57 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:49.939101 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-039195eb-efb1-4734-a183-f6fedd1eaf3d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:49.939787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-039195eb-efb1-4734-a183-f6fedd1eaf3d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:49.940552 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-039195eb-efb1-4734-a183-f6fedd1eaf3d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:49.940987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-039195eb-efb1-4734-a183-f6fedd1eaf3d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:49.942418 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9921a314-c92a-4831-9862-a69c2fc89b57 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:49.942890 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9921a314-c92a-4831-9862-a69c2fc89b57 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:49.943674 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9921a314-c92a-4831-9862-a69c2fc89b57 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:49.944103 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9921a314-c92a-4831-9862-a69c2fc89b57 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:50.144480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-039195eb-efb1-4734-a183-f6fedd1eaf3d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:50.151981 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-039195eb-efb1-4734-a183-f6fedd1eaf3d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.223018 Jul 07 15:33:50.152777 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 70/133] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:49 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:50.156245 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9921a314-c92a-4831-9862-a69c2fc89b57 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:50.167169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9921a314-c92a-4831-9862-a69c2fc89b57 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.241113 Jul 07 15:33:50.167993 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 64/134] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:49 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:50.935617 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:50.936184 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6bc062aa-240f-4942-a973-ff45ff4ac02c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:50.936535 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6bc062aa-240f-4942-a973-ff45ff4ac02c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:50.943154 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:50.945587 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6bc062aa-240f-4942-a973-ff45ff4ac02c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:50.946095 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6bc062aa-240f-4942-a973-ff45ff4ac02c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:50.946889 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6bc062aa-240f-4942-a973-ff45ff4ac02c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:50.947322 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6bc062aa-240f-4942-a973-ff45ff4ac02c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:50.953311 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:50.954080 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:50.955087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:50.955764 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:51.182742 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:51.186257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6bc062aa-240f-4942-a973-ff45ff4ac02c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:51.194053 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6bc062aa-240f-4942-a973-ff45ff4ac02c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.262233 Jul 07 15:33:51.194650 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 65/135] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:50 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:51.196060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:51.197779 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:51.198858 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ca2e0a0e-5554-4c5c-b80c-2a920ee2c5d5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.267369 Jul 07 15:33:51.199415 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 71/136] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:50 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:51.212542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a1cfdb7f-cc62-44d3-b415-55d7bcd73e2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:51.212542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a1cfdb7f-cc62-44d3-b415-55d7bcd73e2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:51.216810 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c8d9e153-330a-4369-a361-90e02e689c4d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:51.217849 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb7f-cc62-44d3-b415-55d7bcd73e2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:51.218471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb7f-cc62-44d3-b415-55d7bcd73e2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:51.219324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c8d9e153-330a-4369-a361-90e02e689c4d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:51.219440 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb7f-cc62-44d3-b415-55d7bcd73e2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:51.219876 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb7f-cc62-44d3-b415-55d7bcd73e2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:51.226676 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c8d9e153-330a-4369-a361-90e02e689c4d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:51.228205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c8d9e153-330a-4369-a361-90e02e689c4d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:51.229204 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c8d9e153-330a-4369-a361-90e02e689c4d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:51.230091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c8d9e153-330a-4369-a361-90e02e689c4d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:51.435365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a1cfdb7f-cc62-44d3-b415-55d7bcd73e2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:51.440625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c8d9e153-330a-4369-a361-90e02e689c4d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:51.445097 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a1cfdb7f-cc62-44d3-b415-55d7bcd73e2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.248408 Jul 07 15:33:51.445750 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 66/137] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:51 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:51.448956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c8d9e153-330a-4369-a361-90e02e689c4d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.248215 Jul 07 15:33:51.449527 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 72/138] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:51 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:52.211475 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4450b140-54ff-4b72-b8b9-d18f2d399f91 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:52.212232 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4450b140-54ff-4b72-b8b9-d18f2d399f91 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:52.216817 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:52.217546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:52.218585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4450b140-54ff-4b72-b8b9-d18f2d399f91 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:52.219261 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4450b140-54ff-4b72-b8b9-d18f2d399f91 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:52.220406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4450b140-54ff-4b72-b8b9-d18f2d399f91 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:52.221457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4450b140-54ff-4b72-b8b9-d18f2d399f91 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:52.224061 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:52.224512 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:52.225277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:52.225703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:52.415647 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-4450b140-54ff-4b72-b8b9-d18f2d399f91 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:52.432357 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4450b140-54ff-4b72-b8b9-d18f2d399f91 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.224676 Jul 07 15:33:52.433518 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 67/139] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:52 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:52.456087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:52.467237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-52382485-0b0c-4f80-aed3-6acd4ea7e288 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:52.467972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-52382485-0b0c-4f80-aed3-6acd4ea7e288 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:52.471869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:52.471869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:52.471869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3f10a72c-bd36-42db-8efe-999021ef6b2a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.258594 Jul 07 15:33:52.472312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 73/140] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:52 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:33:52.477027 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e293d518-a273-4c0a-9b87-b9176b86efbc tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:52.477699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e293d518-a273-4c0a-9b87-b9176b86efbc tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:52.484317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52382485-0b0c-4f80-aed3-6acd4ea7e288 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:52.484719 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e293d518-a273-4c0a-9b87-b9176b86efbc tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:52.485000 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52382485-0b0c-4f80-aed3-6acd4ea7e288 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:52.485159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e293d518-a273-4c0a-9b87-b9176b86efbc tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:52.485839 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52382485-0b0c-4f80-aed3-6acd4ea7e288 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:52.485946 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e293d518-a273-4c0a-9b87-b9176b86efbc tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:52.486273 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52382485-0b0c-4f80-aed3-6acd4ea7e288 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:52.486386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e293d518-a273-4c0a-9b87-b9176b86efbc tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:52.682779 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e293d518-a273-4c0a-9b87-b9176b86efbc tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:52.690214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-52382485-0b0c-4f80-aed3-6acd4ea7e288 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:52.691093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e293d518-a273-4c0a-9b87-b9176b86efbc tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.217872 Jul 07 15:33:52.691676 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 74/141] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:52 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:52.697827 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-52382485-0b0c-4f80-aed3-6acd4ea7e288 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.235225 Jul 07 15:33:52.698380 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 68/142] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:52 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:53.212225 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-df86749b-a156-4e0d-8817-4c43a8ea42f5 req-1ea7d09b-fe1b-4f40-93aa-7a77637161ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1ae649-fd9a-4dcd-ae5a-384e324e4de9", "name": "network-vif-plugged", "status": "completed", "tag": "81cf072b-a045-4379-a583-082f35faaaf6"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:53.216110 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:53.222031 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-df86749b-a156-4e0d-8817-4c43a8ea42f5 req-1ea7d09b-fe1b-4f40-93aa-7a77637161ae service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:53.222616 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-df86749b-a156-4e0d-8817-4c43a8ea42f5 req-1ea7d09b-fe1b-4f40-93aa-7a77637161ae service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:53.252922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-df86749b-a156-4e0d-8817-4c43a8ea42f5 req-1ea7d09b-fe1b-4f40-93aa-7a77637161ae service nova] Creating event network-vif-plugged:81cf072b-a045-4379-a583-082f35faaaf6 for instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 on hv-cinder-84130 Jul 07 15:33:53.258371 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-df86749b-a156-4e0d-8817-4c43a8ea42f5 req-1ea7d09b-fe1b-4f40-93aa-7a77637161ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050598 Jul 07 15:33:53.259178 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 75/143] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:53.469095 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5e3b4ac4-2f2b-4746-b3cc-f1177fb7a82c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:53.470388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5e3b4ac4-2f2b-4746-b3cc-f1177fb7a82c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:53.479125 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5e3b4ac4-2f2b-4746-b3cc-f1177fb7a82c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:53.479607 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5e3b4ac4-2f2b-4746-b3cc-f1177fb7a82c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:53.480405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5e3b4ac4-2f2b-4746-b3cc-f1177fb7a82c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:53.485852 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5e3b4ac4-2f2b-4746-b3cc-f1177fb7a82c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:53.490038 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:53.491100 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:53.499427 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:53.500052 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:53.500865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:53.501306 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:53.729974 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-5e3b4ac4-2f2b-4746-b3cc-f1177fb7a82c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:53.734241 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:53.737859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:53.739415 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5e3b4ac4-2f2b-4746-b3cc-f1177fb7a82c tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1314 microversion: 2.1 time: 0.274066 Jul 07 15:33:53.740364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 69/144] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:53 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:53.758533 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-47c45539-4bc9-4fd0-884c-3faa006cc6f4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:53.760198 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-47c45539-4bc9-4fd0-884c-3faa006cc6f4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:53.761958 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:53.764036 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:53.768683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c479a397-cb33-4ea5-9f55-78e64cc3350c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.282084 Jul 07 15:33:53.776815 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 76/145] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:53 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:53.783777 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-47c45539-4bc9-4fd0-884c-3faa006cc6f4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:53.784693 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-47c45539-4bc9-4fd0-884c-3faa006cc6f4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:53.785623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-47c45539-4bc9-4fd0-884c-3faa006cc6f4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:53.786220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-47c45539-4bc9-4fd0-884c-3faa006cc6f4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:53.787763 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a61cf03c-adc2-4052-9047-4bb77328a24c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:53.788383 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a61cf03c-adc2-4052-9047-4bb77328a24c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:53.795675 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a61cf03c-adc2-4052-9047-4bb77328a24c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:53.796133 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a61cf03c-adc2-4052-9047-4bb77328a24c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:53.799758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a61cf03c-adc2-4052-9047-4bb77328a24c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:53.799758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a61cf03c-adc2-4052-9047-4bb77328a24c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:54.006414 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-47c45539-4bc9-4fd0-884c-3faa006cc6f4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:54.009745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a61cf03c-adc2-4052-9047-4bb77328a24c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:54.014553 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-47c45539-4bc9-4fd0-884c-3faa006cc6f4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.272360 Jul 07 15:33:54.015200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 70/146] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:53 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:54.017577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a61cf03c-adc2-4052-9047-4bb77328a24c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.239368 Jul 07 15:33:54.018129 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 77/147] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:53 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:54.756176 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-46694317-f34e-43cf-8271-3a7c481a43b4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:54.757413 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-46694317-f34e-43cf-8271-3a7c481a43b4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:54.765914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46694317-f34e-43cf-8271-3a7c481a43b4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:54.765914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46694317-f34e-43cf-8271-3a7c481a43b4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:54.766421 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46694317-f34e-43cf-8271-3a7c481a43b4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:54.766850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46694317-f34e-43cf-8271-3a7c481a43b4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:54.789071 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:54.789675 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:54.796489 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:54.796862 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:54.797620 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:54.802037 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:54.977257 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:54.981640 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-46694317-f34e-43cf-8271-3a7c481a43b4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:54.986012 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:33:54.986461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:54.988268 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:54.989552 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c254005d-92d6-426d-8bd3-da6077322110 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.204750 Jul 07 15:33:54.990122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 78/148] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:54 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:33:54.991085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-46694317-f34e-43cf-8271-3a7c481a43b4 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1502 microversion: 2.1 time: 0.238805 Jul 07 15:33:55.008621 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 71/149] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:54 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:55.037939 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-972a98f1-a8dc-475c-a2dc-3e335f1dcd34 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:55.037939 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-972a98f1-a8dc-475c-a2dc-3e335f1dcd34 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:55.042066 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cc865754-f35b-43bf-bedb-5fc76d35f0c9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:55.043260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-972a98f1-a8dc-475c-a2dc-3e335f1dcd34 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:55.043807 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-972a98f1-a8dc-475c-a2dc-3e335f1dcd34 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:55.045624 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cc865754-f35b-43bf-bedb-5fc76d35f0c9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:55.046265 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-972a98f1-a8dc-475c-a2dc-3e335f1dcd34 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:55.046818 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-972a98f1-a8dc-475c-a2dc-3e335f1dcd34 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:55.058131 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cc865754-f35b-43bf-bedb-5fc76d35f0c9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:55.060422 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cc865754-f35b-43bf-bedb-5fc76d35f0c9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:55.062938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cc865754-f35b-43bf-bedb-5fc76d35f0c9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:55.066462 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cc865754-f35b-43bf-bedb-5fc76d35f0c9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:55.290024 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-972a98f1-a8dc-475c-a2dc-3e335f1dcd34 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:55.291601 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cc865754-f35b-43bf-bedb-5fc76d35f0c9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:55.303704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-972a98f1-a8dc-475c-a2dc-3e335f1dcd34 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.265291 Jul 07 15:33:55.303704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 72/150] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:55 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:33:55.303704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-a11b5344-dc0d-4f43-abb2-06ffcedd7298 req-8d251fe7-2fcc-42b2-8bb2-d597bcd14d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5788db1-1101-4334-abdd-2f11d074751a", "name": "network-vif-plugged", "status": "completed", "tag": "647ad2af-c816-4ebc-a882-af1290b500a2"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:55.313601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-a11b5344-dc0d-4f43-abb2-06ffcedd7298 req-8d251fe7-2fcc-42b2-8bb2-d597bcd14d04 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:55.313808 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cc865754-f35b-43bf-bedb-5fc76d35f0c9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.279705 Jul 07 15:33:55.314179 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-a11b5344-dc0d-4f43-abb2-06ffcedd7298 req-8d251fe7-2fcc-42b2-8bb2-d597bcd14d04 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:55.316802 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 79/151] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:55 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:55.336350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-a11b5344-dc0d-4f43-abb2-06ffcedd7298 req-8d251fe7-2fcc-42b2-8bb2-d597bcd14d04 service nova] Creating event network-vif-plugged:647ad2af-c816-4ebc-a882-af1290b500a2 for instance a5788db1-1101-4334-abdd-2f11d074751a on hv-cinder-84130 Jul 07 15:33:55.344066 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-a11b5344-dc0d-4f43-abb2-06ffcedd7298 req-8d251fe7-2fcc-42b2-8bb2-d597bcd14d04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046159 Jul 07 15:33:55.344675 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 73/152] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:33:56.008246 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:56.009380 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:56.015892 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:56.016342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:56.017101 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:56.018518 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:56.158683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:56.168206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:56.170280 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:56.171665 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9c5ccbd6-f4d4-4233-ba47-6bc2c63a31a0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.167459 Jul 07 15:33:56.172221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 80/153] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:56 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:56.316440 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-499e4398-41e1-4e43-9a72-b9cda964ed6f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:56.317144 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-499e4398-41e1-4e43-9a72-b9cda964ed6f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:56.334505 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8e196a00-af4b-4d5c-9980-d26d4fb27053 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:56.335109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8e196a00-af4b-4d5c-9980-d26d4fb27053 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:56.335619 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-499e4398-41e1-4e43-9a72-b9cda964ed6f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:56.336594 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-499e4398-41e1-4e43-9a72-b9cda964ed6f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:56.344651 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-499e4398-41e1-4e43-9a72-b9cda964ed6f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:56.344651 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-499e4398-41e1-4e43-9a72-b9cda964ed6f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:56.350020 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e196a00-af4b-4d5c-9980-d26d4fb27053 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:56.350484 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e196a00-af4b-4d5c-9980-d26d4fb27053 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:56.351797 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e196a00-af4b-4d5c-9980-d26d4fb27053 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:56.352511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e196a00-af4b-4d5c-9980-d26d4fb27053 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:56.534773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-499e4398-41e1-4e43-9a72-b9cda964ed6f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:56.543098 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-499e4398-41e1-4e43-9a72-b9cda964ed6f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.233321 Jul 07 15:33:56.543995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 74/154] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:56 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:56.559827 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8e196a00-af4b-4d5c-9980-d26d4fb27053 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:56.568119 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8e196a00-af4b-4d5c-9980-d26d4fb27053 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.239271 Jul 07 15:33:56.568684 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 81/155] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:56 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:57.189895 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:57.190498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:57.196541 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:57.196985 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:57.197739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:57.198166 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:57.335017 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:57.345247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:57.346944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:57.348125 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-76dd011c-d88b-41fc-a0db-075f868dd4be tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.162179 Jul 07 15:33:57.348845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 75/156] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:57 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:57.560198 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5ec1dfe8-2a2d-40ec-b916-e2a8f662599c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:57.561455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5ec1dfe8-2a2d-40ec-b916-e2a8f662599c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:57.567829 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5ec1dfe8-2a2d-40ec-b916-e2a8f662599c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:57.568290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5ec1dfe8-2a2d-40ec-b916-e2a8f662599c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:57.569021 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5ec1dfe8-2a2d-40ec-b916-e2a8f662599c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:57.569444 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5ec1dfe8-2a2d-40ec-b916-e2a8f662599c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:57.585507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6ff15c13-e5a6-46b0-88a7-1b87a3113790 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:57.585657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6ff15c13-e5a6-46b0-88a7-1b87a3113790 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:57.591967 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ff15c13-e5a6-46b0-88a7-1b87a3113790 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:57.592579 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ff15c13-e5a6-46b0-88a7-1b87a3113790 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:57.593365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ff15c13-e5a6-46b0-88a7-1b87a3113790 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:57.593800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ff15c13-e5a6-46b0-88a7-1b87a3113790 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:57.788665 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6ff15c13-e5a6-46b0-88a7-1b87a3113790 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:57.791792 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5ec1dfe8-2a2d-40ec-b916-e2a8f662599c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:57.797614 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6ff15c13-e5a6-46b0-88a7-1b87a3113790 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.216550 Jul 07 15:33:57.798591 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 76/157] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:57 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:57.800684 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5ec1dfe8-2a2d-40ec-b916-e2a8f662599c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.244280 Jul 07 15:33:57.801531 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 82/158] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:57 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:58.366227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:58.366839 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:58.373108 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:58.373705 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:58.374461 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:58.374891 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:58.525010 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:58.533773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:58.535438 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:58.536574 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ecc4356a-fbcf-42ed-952b-418ec3d04512 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.174260 Jul 07 15:33:58.537130 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 77/159] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:58 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:33:58.815115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f682465f-da91-418a-a0df-5a89fbc87fc2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:58.816421 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f682465f-da91-418a-a0df-5a89fbc87fc2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:58.822929 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f682465f-da91-418a-a0df-5a89fbc87fc2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:58.823721 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f682465f-da91-418a-a0df-5a89fbc87fc2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:58.823841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-396f8423-2c06-42c1-9b8e-f4846ed4bbed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:58.824789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f682465f-da91-418a-a0df-5a89fbc87fc2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:58.824932 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-396f8423-2c06-42c1-9b8e-f4846ed4bbed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:58.825758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f682465f-da91-418a-a0df-5a89fbc87fc2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:58.856896 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-396f8423-2c06-42c1-9b8e-f4846ed4bbed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:58.858186 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-396f8423-2c06-42c1-9b8e-f4846ed4bbed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:58.861372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-396f8423-2c06-42c1-9b8e-f4846ed4bbed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:58.862633 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-396f8423-2c06-42c1-9b8e-f4846ed4bbed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:59.090896 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-396f8423-2c06-42c1-9b8e-f4846ed4bbed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:59.101425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-396f8423-2c06-42c1-9b8e-f4846ed4bbed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1366 microversion: 2.1 time: 0.286384 Jul 07 15:33:59.103391 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 78/160] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:58 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:59.113683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f682465f-da91-418a-a0df-5a89fbc87fc2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:59.121795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f682465f-da91-418a-a0df-5a89fbc87fc2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.311196 Jul 07 15:33:59.122534 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 83/161] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:33:58 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:33:59.161811 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4a26a045-394b-4917-a748-12fd7687483d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "755010cd-4e7b-4fda-8f13-d884b468425b"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:33:59.162868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4a26a045-394b-4917-a748-12fd7687483d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:59.178340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4a26a045-394b-4917-a748-12fd7687483d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:59.178815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4a26a045-394b-4917-a748-12fd7687483d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:59.179913 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4a26a045-394b-4917-a748-12fd7687483d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:59.180349 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4a26a045-394b-4917-a748-12fd7687483d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:59.555130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:33:59.555872 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:33:59.564020 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:59.564464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:59.565229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:33:59.565655 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:33:59.713994 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:59.724488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:59.727083 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:33:59.729629 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9377238f-e816-4e57-aac0-7940c54dda93 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.178830 Jul 07 15:33:59.730692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 84/162] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:33:59 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:34:00.120207 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-05d04edc-0d69-4dba-8a05-65509362bd7e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:00.121712 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-05d04edc-0d69-4dba-8a05-65509362bd7e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:00.130222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05d04edc-0d69-4dba-8a05-65509362bd7e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:00.130926 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05d04edc-0d69-4dba-8a05-65509362bd7e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:00.132121 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05d04edc-0d69-4dba-8a05-65509362bd7e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:00.132562 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05d04edc-0d69-4dba-8a05-65509362bd7e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:00.322949 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-05d04edc-0d69-4dba-8a05-65509362bd7e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:00.331907 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-05d04edc-0d69-4dba-8a05-65509362bd7e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1556 microversion: 2.1 time: 0.215721 Jul 07 15:34:00.332342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 85/163] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:00 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:34:00.336795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8ad340b2-e7e2-4234-8eb0-1225b91c5703 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:00.337434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8ad340b2-e7e2-4234-8eb0-1225b91c5703 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:00.343768 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ad340b2-e7e2-4234-8eb0-1225b91c5703 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:00.344216 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ad340b2-e7e2-4234-8eb0-1225b91c5703 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:00.345155 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ad340b2-e7e2-4234-8eb0-1225b91c5703 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:00.345588 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ad340b2-e7e2-4234-8eb0-1225b91c5703 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:00.574069 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4a26a045-394b-4917-a748-12fd7687483d tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "POST /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.418041 Jul 07 15:34:00.584491 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 79/164] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:33:59 2022] POST /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c/os-volume_attachments => generated 194 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:00.590945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8ad340b2-e7e2-4234-8eb0-1225b91c5703 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:00.597806 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-6341179f-d4ac-46f5-a09f-ecf0d0567277 req-f44a45f9-0aa7-41ae-aa13-7942817d57f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e85e6b3-ebad-441e-afcd-31692b27b782", "name": "network-vif-plugged", "status": "completed", "tag": "8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:00.609414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8ad340b2-e7e2-4234-8eb0-1225b91c5703 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1361 microversion: 2.1 time: 0.276006 Jul 07 15:34:00.613412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-6341179f-d4ac-46f5-a09f-ecf0d0567277 req-f44a45f9-0aa7-41ae-aa13-7942817d57f1 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:00.614243 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-6341179f-d4ac-46f5-a09f-ecf0d0567277 req-f44a45f9-0aa7-41ae-aa13-7942817d57f1 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:00.622183 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 86/165] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:00 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:00.631671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3b986a6b-c4ac-4d87-8c52-d16c5b17314c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:00.631671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3b986a6b-c4ac-4d87-8c52-d16c5b17314c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:00.632038 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-6341179f-d4ac-46f5-a09f-ecf0d0567277 req-f44a45f9-0aa7-41ae-aa13-7942817d57f1 service nova] Creating event network-vif-plugged:8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a for instance 2e85e6b3-ebad-441e-afcd-31692b27b782 on hv-cinder-84130 Jul 07 15:34:00.638995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-6341179f-d4ac-46f5-a09f-ecf0d0567277 req-f44a45f9-0aa7-41ae-aa13-7942817d57f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051502 Jul 07 15:34:00.639949 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 80/166] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:00.667509 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b986a6b-c4ac-4d87-8c52-d16c5b17314c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:00.667996 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b986a6b-c4ac-4d87-8c52-d16c5b17314c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:00.671611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b986a6b-c4ac-4d87-8c52-d16c5b17314c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:00.672075 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b986a6b-c4ac-4d87-8c52-d16c5b17314c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:00.749635 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:00.756965 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:00.768815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:00.770039 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:00.771245 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:00.775387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:00.940488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3b986a6b-c4ac-4d87-8c52-d16c5b17314c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.317201 Jul 07 15:34:00.941232 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 87/167] 10.222.0.25 () {58 vars in 1274 bytes} [Thu Jul 7 15:34:00 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-interface => generated 285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:01.194707 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:01.203225 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:01.204780 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:01.206055 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1ec4a7d1-95bf-4f93-a405-4217d49a3934 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.462340 Jul 07 15:34:01.206622 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 81/168] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:34:00 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:34:01.640989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1502e251-ed06-4c51-a100-9514c60d5a22 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:01.642718 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1502e251-ed06-4c51-a100-9514c60d5a22 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:01.651354 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:01.656832 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1502e251-ed06-4c51-a100-9514c60d5a22 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:01.657533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1502e251-ed06-4c51-a100-9514c60d5a22 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:01.658805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1502e251-ed06-4c51-a100-9514c60d5a22 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:01.659785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1502e251-ed06-4c51-a100-9514c60d5a22 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:02.042527 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1502e251-ed06-4c51-a100-9514c60d5a22 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:02.051051 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1502e251-ed06-4c51-a100-9514c60d5a22 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1545 microversion: 2.1 time: 0.416070 Jul 07 15:34:02.051655 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 88/169] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:01 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1545 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:02.068221 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e3b944e9-a405-4f7a-8e0f-44b116d1ecab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:02.068776 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e3b944e9-a405-4f7a-8e0f-44b116d1ecab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:02.075272 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e3b944e9-a405-4f7a-8e0f-44b116d1ecab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:02.075987 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e3b944e9-a405-4f7a-8e0f-44b116d1ecab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:02.077098 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e3b944e9-a405-4f7a-8e0f-44b116d1ecab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:02.078107 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e3b944e9-a405-4f7a-8e0f-44b116d1ecab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:02.227664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:02.227664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:02.231679 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:02.232653 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:02.233568 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:02.234006 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:02.234774 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e3b944e9-a405-4f7a-8e0f-44b116d1ecab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170234 Jul 07 15:34:02.235642 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 82/170] 10.222.0.25 () {58 vars in 1274 bytes} [Thu Jul 7 15:34:02 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:02.529386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:02.541445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:02.543162 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:02.545259 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c49cd85b-b016-4049-82f2-46dae1032528 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1406 microversion: 2.20 time: 0.324096 Jul 07 15:34:02.557635 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 89/171] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:34:02 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:34:02.901766 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-f086b0ee-b223-442c-9c5a-b0bd4e4f81e2 req-113b5bd4-0293-4bac-9df7-4d0b0c83b43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1ae649-fd9a-4dcd-ae5a-384e324e4de9", "tag": "81cf072b-a045-4379-a583-082f35faaaf6"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:02.922293 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-f086b0ee-b223-442c-9c5a-b0bd4e4f81e2 req-113b5bd4-0293-4bac-9df7-4d0b0c83b43a service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:02.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-f086b0ee-b223-442c-9c5a-b0bd4e4f81e2 req-113b5bd4-0293-4bac-9df7-4d0b0c83b43a service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:02.975769 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-f086b0ee-b223-442c-9c5a-b0bd4e4f81e2 req-113b5bd4-0293-4bac-9df7-4d0b0c83b43a service nova] Creating event network-changed:81cf072b-a045-4379-a583-082f35faaaf6 for instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 on hv-cinder-84130 Jul 07 15:34:03.000409 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-f086b0ee-b223-442c-9c5a-b0bd4e4f81e2 req-113b5bd4-0293-4bac-9df7-4d0b0c83b43a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100646 Jul 07 15:34:03.001246 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 83/172] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:03.569884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:03.570608 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:03.578293 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:03.578845 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:03.580646 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:03.581167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:03.751194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:03.762705 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:03.766215 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:03.767772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ecb95295-faa7-43c5-92b6-f6d0480bc81b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1599 microversion: 2.20 time: 0.205222 Jul 07 15:34:03.783461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 90/173] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:34:03 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:34:03.786746 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-44181f76-e254-453a-bd5b-661a2eddc434 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:03.787410 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-44181f76-e254-453a-bd5b-661a2eddc434 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:03.799294 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44181f76-e254-453a-bd5b-661a2eddc434 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:03.799829 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44181f76-e254-453a-bd5b-661a2eddc434 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:03.800700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44181f76-e254-453a-bd5b-661a2eddc434 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:03.801396 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44181f76-e254-453a-bd5b-661a2eddc434 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:03.932675 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-44181f76-e254-453a-bd5b-661a2eddc434 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.150150 Jul 07 15:34:03.933594 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 84/174] 10.222.0.25 () {60 vars in 1315 bytes} [Thu Jul 7 15:34:03 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:34:04.431029 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-253bc7d0-229f-44ea-bce0-d1c7628dc577 req-e981d45a-135d-4d62-8997-99550e19c630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5788db1-1101-4334-abdd-2f11d074751a", "tag": "647ad2af-c816-4ebc-a882-af1290b500a2"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:04.447642 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-253bc7d0-229f-44ea-bce0-d1c7628dc577 req-e981d45a-135d-4d62-8997-99550e19c630 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:04.449101 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-253bc7d0-229f-44ea-bce0-d1c7628dc577 req-e981d45a-135d-4d62-8997-99550e19c630 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:04.497858 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-253bc7d0-229f-44ea-bce0-d1c7628dc577 req-e981d45a-135d-4d62-8997-99550e19c630 service nova] Creating event network-changed:647ad2af-c816-4ebc-a882-af1290b500a2 for instance a5788db1-1101-4334-abdd-2f11d074751a on hv-cinder-84130 Jul 07 15:34:04.515201 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-253bc7d0-229f-44ea-bce0-d1c7628dc577 req-e981d45a-135d-4d62-8997-99550e19c630 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094544 Jul 07 15:34:04.518000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 91/175] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:34:06.161437 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-8415fd9a-a706-4a2c-b893-f201274e4b9a req-30c4806c-7d78-4e2c-ab6d-5352fffbc1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e85e6b3-ebad-441e-afcd-31692b27b782", "tag": "8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:06.172087 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-8415fd9a-a706-4a2c-b893-f201274e4b9a req-30c4806c-7d78-4e2c-ab6d-5352fffbc1e0 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:06.172552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-8415fd9a-a706-4a2c-b893-f201274e4b9a req-30c4806c-7d78-4e2c-ab6d-5352fffbc1e0 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:06.184335 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-8415fd9a-a706-4a2c-b893-f201274e4b9a req-30c4806c-7d78-4e2c-ab6d-5352fffbc1e0 service nova] Creating event network-changed:8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a for instance 2e85e6b3-ebad-441e-afcd-31692b27b782 on hv-cinder-84130 Jul 07 15:34:06.191051 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-8415fd9a-a706-4a2c-b893-f201274e4b9a req-30c4806c-7d78-4e2c-ab6d-5352fffbc1e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034156 Jul 07 15:34:06.191684 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 85/176] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:11.022700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-14d69daa-4d6a-40cd-9ea0-7c03d33bf666 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:11.031350 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-14d69daa-4d6a-40cd-9ea0-7c03d33bf666 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:11.031350 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-14d69daa-4d6a-40cd-9ea0-7c03d33bf666 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:11.031350 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-14d69daa-4d6a-40cd-9ea0-7c03d33bf666 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:11.031647 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-14d69daa-4d6a-40cd-9ea0-7c03d33bf666 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:11.031875 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-14d69daa-4d6a-40cd-9ea0-7c03d33bf666 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:11.057888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-14d69daa-4d6a-40cd-9ea0-7c03d33bf666 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:34:11.180126 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:11.396027 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-14d69daa-4d6a-40cd-9ea0-7c03d33bf666 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 204 len: 0 microversion: 2.1 time: 0.377754 Jul 07 15:34:11.396632 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 92/177] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:34:11 2022] DELETE /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:34:11.406636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-79338e69-b16c-4113-8ff8-627f16903dc8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:11.407333 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-79338e69-b16c-4113-8ff8-627f16903dc8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:11.409286 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=95 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:11.414104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-79338e69-b16c-4113-8ff8-627f16903dc8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:11.414547 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-79338e69-b16c-4113-8ff8-627f16903dc8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:11.415299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-79338e69-b16c-4113-8ff8-627f16903dc8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:11.415832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-79338e69-b16c-4113-8ff8-627f16903dc8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:11.556103 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-79338e69-b16c-4113-8ff8-627f16903dc8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:11.565517 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-79338e69-b16c-4113-8ff8-627f16903dc8 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1554 microversion: 2.1 time: 0.164330 Jul 07 15:34:11.566238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 86/178] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:11 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:12.583059 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c1717960-7e40-4f94-91be-b8ca1f95c487 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:12.583800 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c1717960-7e40-4f94-91be-b8ca1f95c487 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:12.589967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c1717960-7e40-4f94-91be-b8ca1f95c487 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:12.590404 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c1717960-7e40-4f94-91be-b8ca1f95c487 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:12.591687 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c1717960-7e40-4f94-91be-b8ca1f95c487 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:12.592113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c1717960-7e40-4f94-91be-b8ca1f95c487 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:12.733488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c1717960-7e40-4f94-91be-b8ca1f95c487 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:12.741076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c1717960-7e40-4f94-91be-b8ca1f95c487 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1554 microversion: 2.1 time: 0.162563 Jul 07 15:34:12.741648 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 93/179] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:12 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:13.758884 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b87cfe06-061e-4785-ba40-00d1e0a5fdd5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:13.759524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b87cfe06-061e-4785-ba40-00d1e0a5fdd5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:13.766201 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b87cfe06-061e-4785-ba40-00d1e0a5fdd5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:13.766644 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b87cfe06-061e-4785-ba40-00d1e0a5fdd5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:13.767418 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b87cfe06-061e-4785-ba40-00d1e0a5fdd5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:13.767877 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b87cfe06-061e-4785-ba40-00d1e0a5fdd5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:13.900044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b87cfe06-061e-4785-ba40-00d1e0a5fdd5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:13.909623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b87cfe06-061e-4785-ba40-00d1e0a5fdd5 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1554 microversion: 2.1 time: 0.154416 Jul 07 15:34:13.910210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 87/180] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:13 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:14.928242 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-65c7ee24-5c7d-489b-8a09-1544f7af8195 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:14.928847 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-65c7ee24-5c7d-489b-8a09-1544f7af8195 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:14.934937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-65c7ee24-5c7d-489b-8a09-1544f7af8195 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:14.935377 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-65c7ee24-5c7d-489b-8a09-1544f7af8195 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:14.936199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-65c7ee24-5c7d-489b-8a09-1544f7af8195 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:14.936631 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-65c7ee24-5c7d-489b-8a09-1544f7af8195 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:15.066842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-65c7ee24-5c7d-489b-8a09-1544f7af8195 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:15.074774 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-65c7ee24-5c7d-489b-8a09-1544f7af8195 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1554 microversion: 2.1 time: 0.150405 Jul 07 15:34:15.075339 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 94/181] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:14 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:16.092164 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-91feeba7-9742-4a2e-90f1-b5b979d3adba tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:16.093000 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-91feeba7-9742-4a2e-90f1-b5b979d3adba tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:16.101412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-91feeba7-9742-4a2e-90f1-b5b979d3adba tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:16.101412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-91feeba7-9742-4a2e-90f1-b5b979d3adba tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:16.101412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-91feeba7-9742-4a2e-90f1-b5b979d3adba tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:16.101871 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-91feeba7-9742-4a2e-90f1-b5b979d3adba tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:16.254007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-91feeba7-9742-4a2e-90f1-b5b979d3adba tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:16.271290 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-91feeba7-9742-4a2e-90f1-b5b979d3adba tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1554 microversion: 2.1 time: 0.181318 Jul 07 15:34:16.272914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 88/182] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:16 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:16.864868 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-c60413fa-92bb-451d-aaf7-70569587bf01 req-fe883da9-eaac-4dd8-82c4-c139ccc46e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d22cdc4-2300-40f3-a8bb-37bf28c95f2c", "name": "network-vif-deleted", "tag": "432e625d-c22c-438e-bcbb-5f647e3c8f84"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:16.879875 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-c60413fa-92bb-451d-aaf7-70569587bf01 req-fe883da9-eaac-4dd8-82c4-c139ccc46e0c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:16.879875 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-c60413fa-92bb-451d-aaf7-70569587bf01 req-fe883da9-eaac-4dd8-82c4-c139ccc46e0c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:16.898526 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-c60413fa-92bb-451d-aaf7-70569587bf01 req-fe883da9-eaac-4dd8-82c4-c139ccc46e0c service nova] Creating event network-vif-deleted:432e625d-c22c-438e-bcbb-5f647e3c8f84 for instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c on hv-cinder-84130 Jul 07 15:34:16.904543 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-c60413fa-92bb-451d-aaf7-70569587bf01 req-fe883da9-eaac-4dd8-82c4-c139ccc46e0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042959 Jul 07 15:34:16.912189 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 95/183] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:17.290079 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-44014da6-a681-491f-a96f-3cd1dbc53c51 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:17.290750 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-44014da6-a681-491f-a96f-3cd1dbc53c51 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:17.297845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44014da6-a681-491f-a96f-3cd1dbc53c51 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:17.298499 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44014da6-a681-491f-a96f-3cd1dbc53c51 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:17.299262 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44014da6-a681-491f-a96f-3cd1dbc53c51 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:17.299725 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44014da6-a681-491f-a96f-3cd1dbc53c51 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:17.366582 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-44014da6-a681-491f-a96f-3cd1dbc53c51 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:17.375875 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-44014da6-a681-491f-a96f-3cd1dbc53c51 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1345 microversion: 2.1 time: 0.090189 Jul 07 15:34:17.378284 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 89/184] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:17 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:18.395312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:18.399644 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:18.404722 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:18.405377 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:18.406410 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:18.407030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:18.463180 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:18.464093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:18.464765 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lazy-loading 'fault' on Instance uuid 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:34:18.517333 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b1c9c68db4175a1383bb588b5e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78a55fc7dba4ed5b22675b585cfe3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:18.525974 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-116e30fd-6015-4685-8404-852d87759ad1 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 200 len: 1350 microversion: 2.1 time: 0.136771 Jul 07 15:34:18.526645 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 96/185] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:18 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:19.544910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:19.545599 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:19.552214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:19.552655 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:19.553407 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:19.554138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:19.567882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] HTTP exception thrown: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Request method failure captured: Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c HTTP/1.1 Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy4ttvCA-JutYckWonb6SFr0z8bgXoFDlJ07UJVT5ujlXgvWS0VstybMHcKC7oxN5WSV7fd6knDkDVKAH-i1acYrwuENVRuTLWl5u_tyuWjQ6mjqQlLkVaod-UwtrH5D4dC5U_xmpw_KlzRo2GneA-0JRz_HhUrmwK7Jx57o40ePus Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: b78a55fc7dba4ed5b22675b585cfe3aa Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:34:19.572448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b78a55fc7dba4ed5b22675b585cfe3aa", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: b78a55fc7dba4ed5b22675b585cfe3aa Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-DeleteServersTestJSON-1979476286-project Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 332b1c9c68db4175a1383bb588b5e822 Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-DeleteServersTestJSON-1979476286-project Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.573883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '5d22cdc4-2300-40f3-a8bb-37bf28c95f2c'} Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:34:19.574879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.576227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.577464 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Returning 404 to user: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:34:19.577464 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4e83aa2a-fef9-43ca-98ab-019eceac24a7 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 404 len: 111 microversion: 2.1 time: 0.034536 Jul 07 15:34:19.577464 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 90/186] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:19 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:34:19.681060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:19.681973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:19.688783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:19.689236 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:19.690040 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:19.690475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:19.706430 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] HTTP exception thrown: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Request method failure captured: Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c/os-volume_attachments HTTP/1.1 Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy4ttvCA-JutYckWonb6SFr0z8bgXoFDlJ07UJVT5ujlXgvWS0VstybMHcKC7oxN5WSV7fd6knDkDVKAH-i1acYrwuENVRuTLWl5u_tyuWjQ6mjqQlLkVaod-UwtrH5D4dC5U_xmpw_KlzRo2GneA-0JRz_HhUrmwK7Jx57o40ePus Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: b78a55fc7dba4ed5b22675b585cfe3aa Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:34:19.710770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b78a55fc7dba4ed5b22675b585cfe3aa", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: b78a55fc7dba4ed5b22675b585cfe3aa Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-DeleteServersTestJSON-1979476286-project Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 332b1c9c68db4175a1383bb588b5e822 Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-DeleteServersTestJSON-1979476286-project Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.712219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'server_id': '5d22cdc4-2300-40f3-a8bb-37bf28c95f2c'} Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:34:19.712956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:19.714202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:19.715371 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Returning 404 to user: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:34:19.715371 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e9a85aed-77f8-4554-b091-5c18e00cf387 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035004 Jul 07 15:34:19.715371 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 97/187] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:34:19 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:34:21.122675 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:21.123305 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:21.130396 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:21.131251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:21.132247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:21.132913 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:21.137556 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:21.149913 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] HTTP exception thrown: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Request method failure captured: Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: DELETE /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c HTTP/1.1 Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy4ttvCA-JutYckWonb6SFr0z8bgXoFDlJ07UJVT5ujlXgvWS0VstybMHcKC7oxN5WSV7fd6knDkDVKAH-i1acYrwuENVRuTLWl5u_tyuWjQ6mjqQlLkVaod-UwtrH5D4dC5U_xmpw_KlzRo2GneA-0JRz_HhUrmwK7Jx57o40ePus Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: b78a55fc7dba4ed5b22675b585cfe3aa Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:34:21.151469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b78a55fc7dba4ed5b22675b585cfe3aa", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: b78a55fc7dba4ed5b22675b585cfe3aa Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-DeleteServersTestJSON-1979476286-project Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 332b1c9c68db4175a1383bb588b5e822 Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-DeleteServersTestJSON-1979476286-project Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.152938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '5d22cdc4-2300-40f3-a8bb-37bf28c95f2c'} Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:34:21.153848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.155485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.157816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Returning 404 to user: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:34:21.157816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1bb1c4e0-2f05-44b9-a4fe-6f14c3efeedb tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 404 len: 111 microversion: 2.1 time: 0.034221 Jul 07 15:34:21.157816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 91/188] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:34:21 2022] DELETE /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:34:21.163537 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:21.164708 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] [instance: 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:21.171333 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:21.172789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:21.173724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:21.174149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:21.189026 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] HTTP exception thrown: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Request method failure captured: Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c HTTP/1.1 Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy4ttvCA-JutYckWonb6SFr0z8bgXoFDlJ07UJVT5ujlXgvWS0VstybMHcKC7oxN5WSV7fd6knDkDVKAH-i1acYrwuENVRuTLWl5u_tyuWjQ6mjqQlLkVaod-UwtrH5D4dC5U_xmpw_KlzRo2GneA-0JRz_HhUrmwK7Jx57o40ePus Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: b78a55fc7dba4ed5b22675b585cfe3aa Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:34:21.191384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b78a55fc7dba4ed5b22675b585cfe3aa", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b78a55fc7dba4ed5b22675b585cfe3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: b78a55fc7dba4ed5b22675b585cfe3aa Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-DeleteServersTestJSON-1979476286 Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-DeleteServersTestJSON-1979476286-project Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 332b1c9c68db4175a1383bb588b5e822 Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-DeleteServersTestJSON-1979476286-project Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.196134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '5d22cdc4-2300-40f3-a8bb-37bf28c95f2c'} Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:34:21.197081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. Jul 07 15:34:21.198386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:34:21.199659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] Returning 404 to user: Instance 5d22cdc4-2300-40f3-a8bb-37bf28c95f2c could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:34:21.199659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-626d1340-33f0-45ee-a6bf-5097bc9daf54 tempest-DeleteServersTestJSON-1979476286 tempest-DeleteServersTestJSON-1979476286-project] 10.222.0.25 "GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c" status: 404 len: 111 microversion: 2.1 time: 0.033511 Jul 07 15:34:21.199659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 98/189] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:21 2022] GET /compute/v2.1/servers/5d22cdc4-2300-40f3-a8bb-37bf28c95f2c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:34:33.906284 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=11 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:34.028321 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1352806493", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:34.085014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] validate_networks() for [('b4a3d0bd-27a0-4957-a668-c94979f88543', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:34:34.449695 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:34:34.450109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:34:34.450602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:34:34.451034 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:34:34.451445 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:34:34.460929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:34.461374 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:34.462244 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:34.462671 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:34.480501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Getting quotas for project 8404651e9fb4443a9cdebb3f79a4e6a8. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:34:34.485046 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Getting quotas for user 9528a9a3306d49b0978d77d1ce1ca900 and project 8404651e9fb4443a9cdebb3f79a4e6a8. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:34:34.496408 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:34:34.498724 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:34:34.648519 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b2c8bfa6-0c29-44bc-ab5d-1a586eb33283 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.747884 Jul 07 15:34:34.649290 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 92/190] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:34:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:34:34.659612 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3c82b0fd-02cb-4340-9e62-719d796df010 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:34.660218 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3c82b0fd-02cb-4340-9e62-719d796df010 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:34.664436 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:34.665214 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=26 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:34.728603 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3c82b0fd-02cb-4340-9e62-719d796df010 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:34.737925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3c82b0fd-02cb-4340-9e62-719d796df010 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1222 microversion: 2.1 time: 0.082640 Jul 07 15:34:34.738742 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 99/191] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:34 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:34.798942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-117889811", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:34.861538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] validate_networks() for [('b4a3d0bd-27a0-4957-a668-c94979f88543', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:34:35.252243 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:34:35.252832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:34:35.253108 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:34:35.253512 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:34:35.253900 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:34:35.263580 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:35.264028 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:35.265373 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:35.265961 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:35.283905 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Getting quotas for project 8404651e9fb4443a9cdebb3f79a4e6a8. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:34:35.287787 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Getting quotas for user 9528a9a3306d49b0978d77d1ce1ca900 and project 8404651e9fb4443a9cdebb3f79a4e6a8. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:34:35.299111 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:34:35.301326 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:34:35.438025 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-765c0c9f-9763-445d-b051-6bd7ede16341 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.643226 Jul 07 15:34:35.439274 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 93/192] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:34:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:34:35.450434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a0223c9b-113a-4405-aec3-04b9afd5741d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:35.451127 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a0223c9b-113a-4405-aec3-04b9afd5741d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:35.550134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a0223c9b-113a-4405-aec3-04b9afd5741d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:35.557858 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a0223c9b-113a-4405-aec3-04b9afd5741d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1221 microversion: 2.1 time: 0.112864 Jul 07 15:34:35.558586 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 100/193] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:35 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:36.575550 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8c0286ad-f90b-4701-93e0-84ff338deb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:36.576496 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8c0286ad-f90b-4701-93e0-84ff338deb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:36.583615 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c0286ad-f90b-4701-93e0-84ff338deb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:36.584161 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c0286ad-f90b-4701-93e0-84ff338deb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:36.584810 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c0286ad-f90b-4701-93e0-84ff338deb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:36.585242 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c0286ad-f90b-4701-93e0-84ff338deb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:36.658539 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8c0286ad-f90b-4701-93e0-84ff338deb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:36.666680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8c0286ad-f90b-4701-93e0-84ff338deb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1225 microversion: 2.1 time: 0.095518 Jul 07 15:34:36.667311 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 94/194] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:36 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:37.682951 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ca14986d-6bed-4c07-b668-6bd8bf6dfeb5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:37.683465 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ca14986d-6bed-4c07-b668-6bd8bf6dfeb5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:37.689616 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ca14986d-6bed-4c07-b668-6bd8bf6dfeb5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:37.690056 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ca14986d-6bed-4c07-b668-6bd8bf6dfeb5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:37.690800 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ca14986d-6bed-4c07-b668-6bd8bf6dfeb5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:37.691224 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ca14986d-6bed-4c07-b668-6bd8bf6dfeb5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:37.753140 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ca14986d-6bed-4c07-b668-6bd8bf6dfeb5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:37.762785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ca14986d-6bed-4c07-b668-6bd8bf6dfeb5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1273 microversion: 2.1 time: 0.083453 Jul 07 15:34:37.763320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 101/195] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:37 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:38.779136 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6ecb1865-6ad5-45a1-b067-b6fe0a148b93 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:38.779803 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6ecb1865-6ad5-45a1-b067-b6fe0a148b93 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:38.786264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ecb1865-6ad5-45a1-b067-b6fe0a148b93 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:38.787658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ecb1865-6ad5-45a1-b067-b6fe0a148b93 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:38.787658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ecb1865-6ad5-45a1-b067-b6fe0a148b93 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:38.787923 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ecb1865-6ad5-45a1-b067-b6fe0a148b93 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:38.866919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6ecb1865-6ad5-45a1-b067-b6fe0a148b93 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:38.877946 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6ecb1865-6ad5-45a1-b067-b6fe0a148b93 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1281 microversion: 2.1 time: 0.102652 Jul 07 15:34:38.893755 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 95/196] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:38 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:39.894807 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cc87bd7a-9a0d-4805-9b65-b0c1dbc7177d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:39.895419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cc87bd7a-9a0d-4805-9b65-b0c1dbc7177d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:39.901446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cc87bd7a-9a0d-4805-9b65-b0c1dbc7177d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:39.901892 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cc87bd7a-9a0d-4805-9b65-b0c1dbc7177d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:39.902654 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cc87bd7a-9a0d-4805-9b65-b0c1dbc7177d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:39.903240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cc87bd7a-9a0d-4805-9b65-b0c1dbc7177d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:40.086657 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cc87bd7a-9a0d-4805-9b65-b0c1dbc7177d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:40.095883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cc87bd7a-9a0d-4805-9b65-b0c1dbc7177d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.204572 Jul 07 15:34:40.097305 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 102/197] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:39 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:40.699535 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-f8cfef20-90ab-4cbd-8d73-a3ecc1898965 req-005bcb2d-3082-45bd-9df9-88a1b791e67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c2472d-0015-49d1-ab4c-7eb597cbaa69", "tag": "3d9501ce-92dd-42ac-aa7f-f93d92682896"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:40.719007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-f8cfef20-90ab-4cbd-8d73-a3ecc1898965 req-005bcb2d-3082-45bd-9df9-88a1b791e67f service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:40.719452 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-f8cfef20-90ab-4cbd-8d73-a3ecc1898965 req-005bcb2d-3082-45bd-9df9-88a1b791e67f service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:40.740098 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-f8cfef20-90ab-4cbd-8d73-a3ecc1898965 req-005bcb2d-3082-45bd-9df9-88a1b791e67f service nova] Creating event network-changed:3d9501ce-92dd-42ac-aa7f-f93d92682896 for instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 on hv-cinder-84130 Jul 07 15:34:40.754490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-f8cfef20-90ab-4cbd-8d73-a3ecc1898965 req-005bcb2d-3082-45bd-9df9-88a1b791e67f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060589 Jul 07 15:34:40.755096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 96/198] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:41.126784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f4cc19bc-cbde-4321-8579-0e44a60ae588 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:41.128658 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f4cc19bc-cbde-4321-8579-0e44a60ae588 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:41.134771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f4cc19bc-cbde-4321-8579-0e44a60ae588 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:41.135474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f4cc19bc-cbde-4321-8579-0e44a60ae588 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:41.136016 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f4cc19bc-cbde-4321-8579-0e44a60ae588 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:41.136448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f4cc19bc-cbde-4321-8579-0e44a60ae588 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:41.332293 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f4cc19bc-cbde-4321-8579-0e44a60ae588 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:41.342062 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f4cc19bc-cbde-4321-8579-0e44a60ae588 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.219639 Jul 07 15:34:41.346523 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 103/199] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:41 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:42.360781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-28a8e266-d665-4297-8de0-6cc6ef03863a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:42.361491 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-28a8e266-d665-4297-8de0-6cc6ef03863a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:42.367591 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-28a8e266-d665-4297-8de0-6cc6ef03863a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:42.368045 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-28a8e266-d665-4297-8de0-6cc6ef03863a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:42.369038 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-28a8e266-d665-4297-8de0-6cc6ef03863a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:42.369463 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-28a8e266-d665-4297-8de0-6cc6ef03863a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:42.535894 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-28a8e266-d665-4297-8de0-6cc6ef03863a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:42.547002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-28a8e266-d665-4297-8de0-6cc6ef03863a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.190688 Jul 07 15:34:42.548080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 97/200] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:42 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:42.783443 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-0a07ed05-2ee4-46d7-9b1e-6e8f388dca82 req-e3f6c774-b1d9-42b4-b17d-04ac31e9e01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f6716b-a8c3-4705-8a18-390af053ad3b", "tag": "3537eab4-d5c1-44c3-af6a-0429074eef9e"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:42.792526 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-0a07ed05-2ee4-46d7-9b1e-6e8f388dca82 req-e3f6c774-b1d9-42b4-b17d-04ac31e9e01d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:42.794036 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-0a07ed05-2ee4-46d7-9b1e-6e8f388dca82 req-e3f6c774-b1d9-42b4-b17d-04ac31e9e01d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:42.805480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-0a07ed05-2ee4-46d7-9b1e-6e8f388dca82 req-e3f6c774-b1d9-42b4-b17d-04ac31e9e01d service nova] Creating event network-changed:3537eab4-d5c1-44c3-af6a-0429074eef9e for instance e3f6716b-a8c3-4705-8a18-390af053ad3b on hv-cinder-84130 Jul 07 15:34:42.815272 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-0a07ed05-2ee4-46d7-9b1e-6e8f388dca82 req-e3f6c774-b1d9-42b4-b17d-04ac31e9e01d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040431 Jul 07 15:34:42.817248 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 104/201] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:43.564130 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8d14b324-394b-489b-943c-4dd83ab4f81d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:43.564816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8d14b324-394b-489b-943c-4dd83ab4f81d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:43.572470 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8d14b324-394b-489b-943c-4dd83ab4f81d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:43.573096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8d14b324-394b-489b-943c-4dd83ab4f81d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:43.574027 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8d14b324-394b-489b-943c-4dd83ab4f81d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:43.574609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8d14b324-394b-489b-943c-4dd83ab4f81d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:43.705257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8d14b324-394b-489b-943c-4dd83ab4f81d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:43.712669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8d14b324-394b-489b-943c-4dd83ab4f81d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.152733 Jul 07 15:34:43.713226 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 98/202] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:43 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:44.730864 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a9e9ca40-36d3-47d7-bc2e-507c1ae25b6d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:44.731612 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a9e9ca40-36d3-47d7-bc2e-507c1ae25b6d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:44.738426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9e9ca40-36d3-47d7-bc2e-507c1ae25b6d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:44.738872 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9e9ca40-36d3-47d7-bc2e-507c1ae25b6d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:44.739655 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9e9ca40-36d3-47d7-bc2e-507c1ae25b6d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:44.740084 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9e9ca40-36d3-47d7-bc2e-507c1ae25b6d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:44.874415 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a9e9ca40-36d3-47d7-bc2e-507c1ae25b6d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:44.882003 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a9e9ca40-36d3-47d7-bc2e-507c1ae25b6d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.155715 Jul 07 15:34:44.882569 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 105/203] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:44 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:45.899899 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-db54d35e-244d-4602-b5cb-005963111e0f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:45.900627 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-db54d35e-244d-4602-b5cb-005963111e0f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:45.903552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=4 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:45.904452 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=12 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:45.910141 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-db54d35e-244d-4602-b5cb-005963111e0f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:45.910611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-db54d35e-244d-4602-b5cb-005963111e0f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:45.911678 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-db54d35e-244d-4602-b5cb-005963111e0f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:45.912217 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-db54d35e-244d-4602-b5cb-005963111e0f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:46.070171 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-db54d35e-244d-4602-b5cb-005963111e0f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:46.078141 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-db54d35e-244d-4602-b5cb-005963111e0f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.182518 Jul 07 15:34:46.079185 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 99/204] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:45 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:47.097993 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3117f541-2d9d-4afe-aa96-8276f61e8057 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:47.098596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3117f541-2d9d-4afe-aa96-8276f61e8057 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:47.100553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=4 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:34:47.105708 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3117f541-2d9d-4afe-aa96-8276f61e8057 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:47.106152 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3117f541-2d9d-4afe-aa96-8276f61e8057 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:47.108138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3117f541-2d9d-4afe-aa96-8276f61e8057 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:47.108138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3117f541-2d9d-4afe-aa96-8276f61e8057 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:47.257888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3117f541-2d9d-4afe-aa96-8276f61e8057 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:47.265865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3117f541-2d9d-4afe-aa96-8276f61e8057 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.171817 Jul 07 15:34:47.266429 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 106/205] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:47 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:48.282072 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-829f0814-6fea-4654-99b2-7058928c4347 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:48.282773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-829f0814-6fea-4654-99b2-7058928c4347 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:48.289504 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-829f0814-6fea-4654-99b2-7058928c4347 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:48.290044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-829f0814-6fea-4654-99b2-7058928c4347 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:48.290814 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-829f0814-6fea-4654-99b2-7058928c4347 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:48.291242 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-829f0814-6fea-4654-99b2-7058928c4347 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:48.426207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-829f0814-6fea-4654-99b2-7058928c4347 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:48.433676 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-829f0814-6fea-4654-99b2-7058928c4347 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.155401 Jul 07 15:34:48.434249 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 100/206] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:48 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:49.450793 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cf990a2f-c3d5-4ef1-a9d2-6a38a94d2c53 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:49.451465 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cf990a2f-c3d5-4ef1-a9d2-6a38a94d2c53 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:49.458309 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf990a2f-c3d5-4ef1-a9d2-6a38a94d2c53 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:49.458759 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf990a2f-c3d5-4ef1-a9d2-6a38a94d2c53 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:49.459528 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf990a2f-c3d5-4ef1-a9d2-6a38a94d2c53 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:49.460143 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf990a2f-c3d5-4ef1-a9d2-6a38a94d2c53 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:49.598070 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cf990a2f-c3d5-4ef1-a9d2-6a38a94d2c53 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:49.605909 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cf990a2f-c3d5-4ef1-a9d2-6a38a94d2c53 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.159388 Jul 07 15:34:49.606589 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 107/207] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:49 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:50.622482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4488fc1d-2f67-46db-81b0-6a17a9525caf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:50.623089 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4488fc1d-2f67-46db-81b0-6a17a9525caf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:50.629753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4488fc1d-2f67-46db-81b0-6a17a9525caf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:50.630527 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4488fc1d-2f67-46db-81b0-6a17a9525caf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:50.630941 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4488fc1d-2f67-46db-81b0-6a17a9525caf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:50.631960 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4488fc1d-2f67-46db-81b0-6a17a9525caf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:50.767337 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-4488fc1d-2f67-46db-81b0-6a17a9525caf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:50.774700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4488fc1d-2f67-46db-81b0-6a17a9525caf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.156076 Jul 07 15:34:50.775258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 101/208] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:50 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:51.412009 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-ad818cd5-d0ef-4fdf-914a-1d5c7b7beaa1 req-0ecda9ad-2d52-4b72-a55d-bb122c850035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c2472d-0015-49d1-ab4c-7eb597cbaa69", "name": "network-vif-plugged", "status": "completed", "tag": "3d9501ce-92dd-42ac-aa7f-f93d92682896"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:51.420300 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-ad818cd5-d0ef-4fdf-914a-1d5c7b7beaa1 req-0ecda9ad-2d52-4b72-a55d-bb122c850035 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:51.420735 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-ad818cd5-d0ef-4fdf-914a-1d5c7b7beaa1 req-0ecda9ad-2d52-4b72-a55d-bb122c850035 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:51.431511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-ad818cd5-d0ef-4fdf-914a-1d5c7b7beaa1 req-0ecda9ad-2d52-4b72-a55d-bb122c850035 service nova] Creating event network-vif-plugged:3d9501ce-92dd-42ac-aa7f-f93d92682896 for instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 on hv-cinder-84130 Jul 07 15:34:51.436434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-ad818cd5-d0ef-4fdf-914a-1d5c7b7beaa1 req-0ecda9ad-2d52-4b72-a55d-bb122c850035 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028079 Jul 07 15:34:51.437007 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 108/209] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:51.792944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0df9cc85-d86f-4aa5-93ce-4cfc4279579f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:51.794124 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0df9cc85-d86f-4aa5-93ce-4cfc4279579f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:51.804074 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0df9cc85-d86f-4aa5-93ce-4cfc4279579f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:51.805014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0df9cc85-d86f-4aa5-93ce-4cfc4279579f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:51.806335 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0df9cc85-d86f-4aa5-93ce-4cfc4279579f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:51.806947 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0df9cc85-d86f-4aa5-93ce-4cfc4279579f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:51.967447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0df9cc85-d86f-4aa5-93ce-4cfc4279579f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:51.978050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0df9cc85-d86f-4aa5-93ce-4cfc4279579f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.189270 Jul 07 15:34:51.978652 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 102/210] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:51 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:34:52.994953 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fe0fbd0d-8c72-4c41-b88d-9e4515553cbb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:52.995694 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fe0fbd0d-8c72-4c41-b88d-9e4515553cbb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:53.002863 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fe0fbd0d-8c72-4c41-b88d-9e4515553cbb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:53.003239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fe0fbd0d-8c72-4c41-b88d-9e4515553cbb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:53.004067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fe0fbd0d-8c72-4c41-b88d-9e4515553cbb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:53.004512 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fe0fbd0d-8c72-4c41-b88d-9e4515553cbb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:53.156740 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-fe0fbd0d-8c72-4c41-b88d-9e4515553cbb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:53.164937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fe0fbd0d-8c72-4c41-b88d-9e4515553cbb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.174240 Jul 07 15:34:53.165502 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 109/211] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:52 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:34:53.548630 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-86df92b0-daad-4bef-8ccc-e8c305168184 req-7c02ca1d-338f-4808-8ac3-a99f8ce699ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f6716b-a8c3-4705-8a18-390af053ad3b", "name": "network-vif-plugged", "status": "completed", "tag": "3537eab4-d5c1-44c3-af6a-0429074eef9e"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:53.561717 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-86df92b0-daad-4bef-8ccc-e8c305168184 req-7c02ca1d-338f-4808-8ac3-a99f8ce699ba service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:53.562161 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-86df92b0-daad-4bef-8ccc-e8c305168184 req-7c02ca1d-338f-4808-8ac3-a99f8ce699ba service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:53.583399 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-86df92b0-daad-4bef-8ccc-e8c305168184 req-7c02ca1d-338f-4808-8ac3-a99f8ce699ba service nova] Creating event network-vif-plugged:3537eab4-d5c1-44c3-af6a-0429074eef9e for instance e3f6716b-a8c3-4705-8a18-390af053ad3b on hv-cinder-84130 Jul 07 15:34:53.588566 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-86df92b0-daad-4bef-8ccc-e8c305168184 req-7c02ca1d-338f-4808-8ac3-a99f8ce699ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044154 Jul 07 15:34:53.589258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 103/212] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:34:54.182804 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-18be8bfa-fed4-47f9-bfa6-f612eb740d40 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:54.183485 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-18be8bfa-fed4-47f9-bfa6-f612eb740d40 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:54.191738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-18be8bfa-fed4-47f9-bfa6-f612eb740d40 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:54.192274 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-18be8bfa-fed4-47f9-bfa6-f612eb740d40 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:54.193634 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-18be8bfa-fed4-47f9-bfa6-f612eb740d40 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:54.194336 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-18be8bfa-fed4-47f9-bfa6-f612eb740d40 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:54.327358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-18be8bfa-fed4-47f9-bfa6-f612eb740d40 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:54.334964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-18be8bfa-fed4-47f9-bfa6-f612eb740d40 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.156188 Jul 07 15:34:54.335533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 110/213] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:54 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:55.352300 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-aa9d1404-e7d2-4253-8300-8ec550c42986 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:55.352998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-aa9d1404-e7d2-4253-8300-8ec550c42986 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:55.360088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-aa9d1404-e7d2-4253-8300-8ec550c42986 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:55.360546 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-aa9d1404-e7d2-4253-8300-8ec550c42986 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:55.361311 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-aa9d1404-e7d2-4253-8300-8ec550c42986 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:55.361743 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-aa9d1404-e7d2-4253-8300-8ec550c42986 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:55.506158 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-aa9d1404-e7d2-4253-8300-8ec550c42986 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:55.513674 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-aa9d1404-e7d2-4253-8300-8ec550c42986 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1321 microversion: 2.1 time: 0.166175 Jul 07 15:34:55.514363 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 104/214] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:55 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:56.530265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-afd5836a-6e01-469b-9ec2-36db44cfc2ba tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:56.538292 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-afd5836a-6e01-469b-9ec2-36db44cfc2ba tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:56.544827 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afd5836a-6e01-469b-9ec2-36db44cfc2ba tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:56.545275 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afd5836a-6e01-469b-9ec2-36db44cfc2ba tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:56.546041 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afd5836a-6e01-469b-9ec2-36db44cfc2ba tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:56.546478 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afd5836a-6e01-469b-9ec2-36db44cfc2ba tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:56.678256 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-afd5836a-6e01-469b-9ec2-36db44cfc2ba tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:56.686085 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-afd5836a-6e01-469b-9ec2-36db44cfc2ba tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1513 microversion: 2.1 time: 0.160233 Jul 07 15:34:56.686649 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 111/215] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:56 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:56.708699 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0ffdb802-1243-422d-9fc2-d7123acd4b00 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:34:56.709622 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0ffdb802-1243-422d-9fc2-d7123acd4b00 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:56.716181 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0ffdb802-1243-422d-9fc2-d7123acd4b00 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:56.716632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0ffdb802-1243-422d-9fc2-d7123acd4b00 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:56.718032 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0ffdb802-1243-422d-9fc2-d7123acd4b00 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:56.718468 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0ffdb802-1243-422d-9fc2-d7123acd4b00 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:56.741091 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-0ffdb802-1243-422d-9fc2-d7123acd4b00 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lazy-loading 'flavor' on Instance uuid e3f6716b-a8c3-4705-8a18-390af053ad3b {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:34:57.087469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0ffdb802-1243-422d-9fc2-d7123acd4b00 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b/action" status: 200 len: 32 microversion: 2.1 time: 0.382704 Jul 07 15:34:57.088096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 105/216] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:34:56 2022] POST /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b/action => generated 32 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:34:57.097183 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-83deb26d-e240-430a-8a43-5353bb28bfc7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:57.097794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-83deb26d-e240-430a-8a43-5353bb28bfc7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:57.103911 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-83deb26d-e240-430a-8a43-5353bb28bfc7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:57.104358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-83deb26d-e240-430a-8a43-5353bb28bfc7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:57.105380 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-83deb26d-e240-430a-8a43-5353bb28bfc7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:57.105814 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-83deb26d-e240-430a-8a43-5353bb28bfc7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:57.232074 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-83deb26d-e240-430a-8a43-5353bb28bfc7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:57.239940 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-83deb26d-e240-430a-8a43-5353bb28bfc7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.146524 Jul 07 15:34:57.240506 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 112/217] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:57 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:58.258382 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fe751dc4-6c3c-40a1-bbb8-f523dde327b8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:58.258987 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fe751dc4-6c3c-40a1-bbb8-f523dde327b8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:58.266259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fe751dc4-6c3c-40a1-bbb8-f523dde327b8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:58.266698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fe751dc4-6c3c-40a1-bbb8-f523dde327b8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:58.267451 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fe751dc4-6c3c-40a1-bbb8-f523dde327b8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:58.267906 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fe751dc4-6c3c-40a1-bbb8-f523dde327b8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:58.399678 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fe751dc4-6c3c-40a1-bbb8-f523dde327b8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:58.407649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fe751dc4-6c3c-40a1-bbb8-f523dde327b8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.153888 Jul 07 15:34:58.408248 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 106/218] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:58 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:34:59.424827 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6350a9d9-32b3-4fa1-9611-16f2f83764d6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:34:59.425463 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6350a9d9-32b3-4fa1-9611-16f2f83764d6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:34:59.431442 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6350a9d9-32b3-4fa1-9611-16f2f83764d6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:59.431920 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6350a9d9-32b3-4fa1-9611-16f2f83764d6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:59.432667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6350a9d9-32b3-4fa1-9611-16f2f83764d6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:34:59.433096 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6350a9d9-32b3-4fa1-9611-16f2f83764d6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:34:59.562947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6350a9d9-32b3-4fa1-9611-16f2f83764d6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:34:59.570439 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6350a9d9-32b3-4fa1-9611-16f2f83764d6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.149570 Jul 07 15:34:59.571007 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 113/219] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:34:59 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:00.587482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-447d6492-a4a0-40ac-924f-e60ace9ff45b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:00.588051 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-447d6492-a4a0-40ac-924f-e60ace9ff45b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:00.598292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-447d6492-a4a0-40ac-924f-e60ace9ff45b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:00.598723 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-447d6492-a4a0-40ac-924f-e60ace9ff45b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:00.599698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-447d6492-a4a0-40ac-924f-e60ace9ff45b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:00.600291 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-447d6492-a4a0-40ac-924f-e60ace9ff45b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:00.741697 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-447d6492-a4a0-40ac-924f-e60ace9ff45b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:00.749739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-447d6492-a4a0-40ac-924f-e60ace9ff45b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.166429 Jul 07 15:35:00.750304 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 107/220] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:00 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:01.791637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5f461e72-df1f-40ce-8e9f-c52e49d3a63d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:01.791637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5f461e72-df1f-40ce-8e9f-c52e49d3a63d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:01.791637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f461e72-df1f-40ce-8e9f-c52e49d3a63d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:01.791637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f461e72-df1f-40ce-8e9f-c52e49d3a63d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:01.792453 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f461e72-df1f-40ce-8e9f-c52e49d3a63d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:01.792453 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f461e72-df1f-40ce-8e9f-c52e49d3a63d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:01.910360 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5f461e72-df1f-40ce-8e9f-c52e49d3a63d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:01.917761 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5f461e72-df1f-40ce-8e9f-c52e49d3a63d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.155581 Jul 07 15:35:01.918314 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 114/221] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:01 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:02.353135 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6d180dc9-a5a1-41d5-9e31-3c09d7eb0271 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:02.353631 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6d180dc9-a5a1-41d5-9e31-3c09d7eb0271 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:02.360584 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d180dc9-a5a1-41d5-9e31-3c09d7eb0271 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:02.361030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d180dc9-a5a1-41d5-9e31-3c09d7eb0271 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:02.361786 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d180dc9-a5a1-41d5-9e31-3c09d7eb0271 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:02.362216 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d180dc9-a5a1-41d5-9e31-3c09d7eb0271 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:02.386152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6d180dc9-a5a1-41d5-9e31-3c09d7eb0271 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/ips" status: 200 len: 152 microversion: 2.20 time: 0.036855 Jul 07 15:35:02.386717 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 108/222] 10.222.0.25 () {60 vars in 1288 bytes} [Thu Jul 7 15:35:02 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:35:02.934100 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1db6455c-0d7f-4d64-8982-6ee71c73ef63 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:02.934739 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1db6455c-0d7f-4d64-8982-6ee71c73ef63 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:02.941500 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1db6455c-0d7f-4d64-8982-6ee71c73ef63 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:02.941956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1db6455c-0d7f-4d64-8982-6ee71c73ef63 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:02.942757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1db6455c-0d7f-4d64-8982-6ee71c73ef63 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:02.943156 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1db6455c-0d7f-4d64-8982-6ee71c73ef63 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:03.097536 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1db6455c-0d7f-4d64-8982-6ee71c73ef63 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:03.108447 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1db6455c-0d7f-4d64-8982-6ee71c73ef63 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.177456 Jul 07 15:35:03.109858 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 115/223] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:02 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:04.125841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ceba2021-8fdc-4539-80bd-1b716cc3d536 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:04.127147 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ceba2021-8fdc-4539-80bd-1b716cc3d536 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:04.129687 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:04.134715 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ceba2021-8fdc-4539-80bd-1b716cc3d536 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:04.135167 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ceba2021-8fdc-4539-80bd-1b716cc3d536 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:04.135977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ceba2021-8fdc-4539-80bd-1b716cc3d536 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:04.136418 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ceba2021-8fdc-4539-80bd-1b716cc3d536 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:04.154872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:04.276818 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ceba2021-8fdc-4539-80bd-1b716cc3d536 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:04.284933 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ceba2021-8fdc-4539-80bd-1b716cc3d536 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.163653 Jul 07 15:35:04.285499 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 109/224] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:04 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:05.302015 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-229c88c1-a87b-4b64-af46-d368b949af48 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:05.302631 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-229c88c1-a87b-4b64-af46-d368b949af48 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:05.308674 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-229c88c1-a87b-4b64-af46-d368b949af48 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:05.310417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-229c88c1-a87b-4b64-af46-d368b949af48 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:05.310417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-229c88c1-a87b-4b64-af46-d368b949af48 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:05.310417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-229c88c1-a87b-4b64-af46-d368b949af48 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:05.314514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=83 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:05.442117 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-229c88c1-a87b-4b64-af46-d368b949af48 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:05.449745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-229c88c1-a87b-4b64-af46-d368b949af48 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.151664 Jul 07 15:35:05.450321 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 116/225] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:05 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:06.467818 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-58c7e15b-f788-45cb-8097-a385658d198f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:06.469165 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-58c7e15b-f788-45cb-8097-a385658d198f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:06.476446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-58c7e15b-f788-45cb-8097-a385658d198f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:06.476998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-58c7e15b-f788-45cb-8097-a385658d198f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:06.477818 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-58c7e15b-f788-45cb-8097-a385658d198f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:06.478241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-58c7e15b-f788-45cb-8097-a385658d198f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:06.614822 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-58c7e15b-f788-45cb-8097-a385658d198f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:06.622300 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-58c7e15b-f788-45cb-8097-a385658d198f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.159546 Jul 07 15:35:06.622887 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 110/226] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:06 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:06.699015 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-229e50bb-366b-4bb2-a5b1-5c44732d50c0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:06.699533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-229e50bb-366b-4bb2-a5b1-5c44732d50c0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:06.701821 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=41 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:06.707262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-229e50bb-366b-4bb2-a5b1-5c44732d50c0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:06.707752 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-229e50bb-366b-4bb2-a5b1-5c44732d50c0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:06.708507 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-229e50bb-366b-4bb2-a5b1-5c44732d50c0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:06.708928 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-229e50bb-366b-4bb2-a5b1-5c44732d50c0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:06.735118 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-229e50bb-366b-4bb2-a5b1-5c44732d50c0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lazy-loading 'flavor' on Instance uuid 2e85e6b3-ebad-441e-afcd-31692b27b782 {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:35:07.340870 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-229e50bb-366b-4bb2-a5b1-5c44732d50c0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/action" status: 202 len: 0 microversion: 2.20 time: 0.646071 Jul 07 15:35:07.341871 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 117/227] 10.222.0.25 () {62 vars in 1318 bytes} [Thu Jul 7 15:35:06 2022] POST /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:35:07.350620 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:07.351363 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:07.357796 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:07.358245 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:07.359647 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:07.360083 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:07.503256 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:07.511859 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:07.513462 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:07.514754 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5fed9140-e5ff-4732-85f1-c2d029191725 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.168134 Jul 07 15:35:07.515381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 111/228] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:07 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:07.640406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bda6dd12-99e5-4fda-90fc-3ad395523ff8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:07.641131 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bda6dd12-99e5-4fda-90fc-3ad395523ff8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:07.647856 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bda6dd12-99e5-4fda-90fc-3ad395523ff8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:07.648511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bda6dd12-99e5-4fda-90fc-3ad395523ff8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:07.649339 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bda6dd12-99e5-4fda-90fc-3ad395523ff8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:07.649771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bda6dd12-99e5-4fda-90fc-3ad395523ff8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:07.787216 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bda6dd12-99e5-4fda-90fc-3ad395523ff8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:07.794714 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bda6dd12-99e5-4fda-90fc-3ad395523ff8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.158633 Jul 07 15:35:07.795276 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 118/229] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:07 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:08.225297 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-877c16d4-4161-4a8d-9169-99c0e5226230 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:08.225783 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-877c16d4-4161-4a8d-9169-99c0e5226230 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:08.232043 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-877c16d4-4161-4a8d-9169-99c0e5226230 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:08.232487 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-877c16d4-4161-4a8d-9169-99c0e5226230 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:08.233243 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-877c16d4-4161-4a8d-9169-99c0e5226230 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:08.236520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-877c16d4-4161-4a8d-9169-99c0e5226230 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:08.257121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-877c16d4-4161-4a8d-9169-99c0e5226230 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/ips" status: 200 len: 150 microversion: 2.1 time: 0.035774 Jul 07 15:35:08.257685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 112/230] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:35:08 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:35:08.534018 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:08.534625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:08.540775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:08.541399 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:08.542150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:08.542771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:08.676084 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:08.683974 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:08.685526 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:08.686670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ce2ffd1c-fbe3-49c4-96b9-4be222f2ed2e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.156672 Jul 07 15:35:08.687865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 119/231] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:08 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:35:08.812643 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ea3fbc75-a2d3-48db-96c7-05729079ab87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:08.970542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ea3fbc75-a2d3-48db-96c7-05729079ab87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:08.970542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ea3fbc75-a2d3-48db-96c7-05729079ab87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:08.970542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ea3fbc75-a2d3-48db-96c7-05729079ab87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:08.970542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ea3fbc75-a2d3-48db-96c7-05729079ab87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:08.974419 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ea3fbc75-a2d3-48db-96c7-05729079ab87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:08.974419 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ea3fbc75-a2d3-48db-96c7-05729079ab87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:08.974419 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ea3fbc75-a2d3-48db-96c7-05729079ab87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.158166 Jul 07 15:35:08.974419 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 113/232] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:08 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:09.626710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-295da637-c667-4bc5-83d3-7551be1592f1 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:09.627273 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-295da637-c667-4bc5-83d3-7551be1592f1 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:09.633239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-295da637-c667-4bc5-83d3-7551be1592f1 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:09.633701 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-295da637-c667-4bc5-83d3-7551be1592f1 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:09.634630 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-295da637-c667-4bc5-83d3-7551be1592f1 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:09.635210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-295da637-c667-4bc5-83d3-7551be1592f1 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:09.658487 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-295da637-c667-4bc5-83d3-7551be1592f1 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/ips" status: 200 len: 144 microversion: 2.1 time: 0.036113 Jul 07 15:35:09.659092 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 120/233] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:35:09 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:35:09.706403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:09.707093 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:09.713046 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:09.713490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:09.714248 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:09.714681 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:09.861387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:09.869808 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:09.871349 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:09.872543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-73a24d74-0866-4a29-aaa3-caa364832fa8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.170816 Jul 07 15:35:09.879673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 114/234] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:09 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:09.993521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-66f63c1b-2841-4e9b-a652-e007d5944931 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:09.994123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-66f63c1b-2841-4e9b-a652-e007d5944931 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:10.001108 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-66f63c1b-2841-4e9b-a652-e007d5944931 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:10.001553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-66f63c1b-2841-4e9b-a652-e007d5944931 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:10.002361 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-66f63c1b-2841-4e9b-a652-e007d5944931 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:10.002784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-66f63c1b-2841-4e9b-a652-e007d5944931 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:10.158560 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-66f63c1b-2841-4e9b-a652-e007d5944931 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:10.166447 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-66f63c1b-2841-4e9b-a652-e007d5944931 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.176630 Jul 07 15:35:10.167019 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 121/235] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:09 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:10.299589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e883df63-db03-45cc-a52e-e621ac84d4ed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1995abe-b0e4-41da-a0ab-d99fde564625"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:10.300674 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e883df63-db03-45cc-a52e-e621ac84d4ed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:10.306626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e883df63-db03-45cc-a52e-e621ac84d4ed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:10.307074 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e883df63-db03-45cc-a52e-e621ac84d4ed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:10.307868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e883df63-db03-45cc-a52e-e621ac84d4ed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:10.308303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e883df63-db03-45cc-a52e-e621ac84d4ed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:10.894397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:10.897908 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:10.901320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:10.901780 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:10.902550 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:10.902980 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:11.047842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:11.055701 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:11.057202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:11.058356 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-56bf41d2-35fa-457b-8ffc-ae2525293712 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.168288 Jul 07 15:35:11.058909 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 122/236] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:10 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:11.190045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-64ba9b32-bdcc-4c9e-b060-2998aa5d6ad6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:11.190263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-64ba9b32-bdcc-4c9e-b060-2998aa5d6ad6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:11.198976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-64ba9b32-bdcc-4c9e-b060-2998aa5d6ad6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:11.199421 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-64ba9b32-bdcc-4c9e-b060-2998aa5d6ad6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:11.200221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-64ba9b32-bdcc-4c9e-b060-2998aa5d6ad6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:11.200675 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-64ba9b32-bdcc-4c9e-b060-2998aa5d6ad6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:11.378147 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-64ba9b32-bdcc-4c9e-b060-2998aa5d6ad6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:11.383329 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e883df63-db03-45cc-a52e-e621ac84d4ed tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.087962 Jul 07 15:35:11.384038 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 115/237] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:35:10 2022] POST /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments => generated 194 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:35:11.391327 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-64ba9b32-bdcc-4c9e-b060-2998aa5d6ad6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.210558 Jul 07 15:35:11.391940 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 123/238] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:11 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:12.079593 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:12.080366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:12.087241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:12.087711 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:12.088578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:12.089004 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:12.247540 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:12.256465 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:12.257976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:12.259127 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8e21260b-3be4-4f45-a4f9-18983b7124f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.185236 Jul 07 15:35:12.259704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 116/239] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:12 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:12.408950 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5d481ace-b423-4981-96e0-d26275f6c527 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:12.409525 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5d481ace-b423-4981-96e0-d26275f6c527 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:12.415450 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5d481ace-b423-4981-96e0-d26275f6c527 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:12.418427 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5d481ace-b423-4981-96e0-d26275f6c527 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:12.418427 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5d481ace-b423-4981-96e0-d26275f6c527 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:12.418427 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5d481ace-b423-4981-96e0-d26275f6c527 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:12.552570 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5d481ace-b423-4981-96e0-d26275f6c527 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:12.560445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5d481ace-b423-4981-96e0-d26275f6c527 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.156126 Jul 07 15:35:12.561000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 124/240] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:12 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:13.021729 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-365481cb-eaa9-46a2-8e45-ade3a2a2c109 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "526e8700-392f-4aff-b051-11684eeb1909"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:13.022872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-365481cb-eaa9-46a2-8e45-ade3a2a2c109 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:13.029214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-365481cb-eaa9-46a2-8e45-ade3a2a2c109 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:13.029652 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-365481cb-eaa9-46a2-8e45-ade3a2a2c109 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:13.030404 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-365481cb-eaa9-46a2-8e45-ade3a2a2c109 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:13.030830 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-365481cb-eaa9-46a2-8e45-ade3a2a2c109 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:13.278187 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:13.278791 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:13.286254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:13.286694 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:13.287977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:13.288753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:13.469654 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:13.478154 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:13.480042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:13.481363 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-30afda61-521f-45f3-a64d-8a5862910588 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.207747 Jul 07 15:35:13.481993 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 125/241] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:13 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:13.577814 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7dc3b49b-8fd8-4d8e-9374-26e21a7c2344 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:13.579061 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7dc3b49b-8fd8-4d8e-9374-26e21a7c2344 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:13.585398 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7dc3b49b-8fd8-4d8e-9374-26e21a7c2344 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:13.585794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7dc3b49b-8fd8-4d8e-9374-26e21a7c2344 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:13.586559 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7dc3b49b-8fd8-4d8e-9374-26e21a7c2344 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:13.586989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7dc3b49b-8fd8-4d8e-9374-26e21a7c2344 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:13.720394 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7dc3b49b-8fd8-4d8e-9374-26e21a7c2344 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:13.728179 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7dc3b49b-8fd8-4d8e-9374-26e21a7c2344 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.154292 Jul 07 15:35:13.729220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 126/242] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:13 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:13.900837 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-365481cb-eaa9-46a2-8e45-ade3a2a2c109 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.882856 Jul 07 15:35:13.901512 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 117/243] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:35:13 2022] POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:35:14.499888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:14.500480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:14.506520 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:14.506958 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:14.507745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:14.508163 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:14.638590 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:14.647038 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:14.648588 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:14.651848 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7cf3f85b-f1e0-4b41-aa13-d702c63b620a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.153842 Jul 07 15:35:14.651848 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 127/244] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:14 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:14.747163 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a909e0a4-3ef1-4cad-be3c-98d3a47aed8c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:14.747802 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a909e0a4-3ef1-4cad-be3c-98d3a47aed8c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:14.754902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a909e0a4-3ef1-4cad-be3c-98d3a47aed8c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:14.755350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a909e0a4-3ef1-4cad-be3c-98d3a47aed8c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:14.756143 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a909e0a4-3ef1-4cad-be3c-98d3a47aed8c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:14.756577 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a909e0a4-3ef1-4cad-be3c-98d3a47aed8c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:14.898572 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a909e0a4-3ef1-4cad-be3c-98d3a47aed8c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:14.908306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a909e0a4-3ef1-4cad-be3c-98d3a47aed8c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.165813 Jul 07 15:35:14.908893 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 118/245] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:14 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:15.668782 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:15.669351 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:15.676192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:15.676637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:15.677399 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:15.677824 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:15.816757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:15.824902 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:15.826407 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:15.829325 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-091250c7-6bc8-425b-b669-47a0b1ae764c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.162749 Jul 07 15:35:15.829325 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 128/246] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:15 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:15.925200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-22de565c-a3a0-431a-b9cb-471c69ac6519 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:15.925920 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-22de565c-a3a0-431a-b9cb-471c69ac6519 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:15.932345 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22de565c-a3a0-431a-b9cb-471c69ac6519 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:15.932792 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22de565c-a3a0-431a-b9cb-471c69ac6519 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:15.933547 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22de565c-a3a0-431a-b9cb-471c69ac6519 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:15.933977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22de565c-a3a0-431a-b9cb-471c69ac6519 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:16.066625 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-22de565c-a3a0-431a-b9cb-471c69ac6519 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:16.074392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-22de565c-a3a0-431a-b9cb-471c69ac6519 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.153746 Jul 07 15:35:16.074963 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 119/247] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:15 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:16.847280 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:16.847994 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:16.854003 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:16.854448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:16.855464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:16.855907 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:16.995745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:17.004668 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:17.005222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:17.006421 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b95f26a2-ff24-4aef-8a0f-8636090ecc2c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.164050 Jul 07 15:35:17.006982 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 129/248] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:16 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:17.092260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fcdf6e42-3c5c-44f9-a1ad-fe883555b72f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:17.092864 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fcdf6e42-3c5c-44f9-a1ad-fe883555b72f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:17.099797 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fcdf6e42-3c5c-44f9-a1ad-fe883555b72f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:17.100249 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fcdf6e42-3c5c-44f9-a1ad-fe883555b72f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:17.101023 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fcdf6e42-3c5c-44f9-a1ad-fe883555b72f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:17.101454 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fcdf6e42-3c5c-44f9-a1ad-fe883555b72f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:17.247177 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fcdf6e42-3c5c-44f9-a1ad-fe883555b72f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:17.255379 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fcdf6e42-3c5c-44f9-a1ad-fe883555b72f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.166960 Jul 07 15:35:17.257893 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 120/249] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:17 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:18.029040 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:18.029638 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:18.036622 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:18.037063 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:18.037821 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:18.038416 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:18.173591 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:18.182927 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:18.184748 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:18.189681 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c8678169-cd13-46ad-87fb-8ac9e3ea62c8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.160803 Jul 07 15:35:18.199687 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 130/250] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:18 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:35:18.272549 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e4ac20d1-72b8-4a94-9207-71fff220c7ea tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:18.273154 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e4ac20d1-72b8-4a94-9207-71fff220c7ea tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:18.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e4ac20d1-72b8-4a94-9207-71fff220c7ea tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:18.280265 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e4ac20d1-72b8-4a94-9207-71fff220c7ea tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:18.281021 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e4ac20d1-72b8-4a94-9207-71fff220c7ea tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:18.282023 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e4ac20d1-72b8-4a94-9207-71fff220c7ea tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:18.425930 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e4ac20d1-72b8-4a94-9207-71fff220c7ea tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:18.433482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e4ac20d1-72b8-4a94-9207-71fff220c7ea tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.164762 Jul 07 15:35:18.434052 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 121/251] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:18 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:19.209331 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:19.209932 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:19.215929 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:19.216377 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:19.217123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:19.217623 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:19.220225 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:19.357655 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:19.366483 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:19.368007 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:19.369170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-489e0357-9dfb-46c6-9643-fdc9ace80624 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.163746 Jul 07 15:35:19.369726 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 131/252] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:19 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:19.450313 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-45be629a-8d39-4a10-a49d-aadf8eb93fbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:19.450848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-45be629a-8d39-4a10-a49d-aadf8eb93fbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:19.457482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-45be629a-8d39-4a10-a49d-aadf8eb93fbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:19.457976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-45be629a-8d39-4a10-a49d-aadf8eb93fbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:19.458731 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-45be629a-8d39-4a10-a49d-aadf8eb93fbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:19.459162 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-45be629a-8d39-4a10-a49d-aadf8eb93fbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:19.595996 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-45be629a-8d39-4a10-a49d-aadf8eb93fbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:19.603799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-45be629a-8d39-4a10-a49d-aadf8eb93fbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.157469 Jul 07 15:35:19.604500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 122/253] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:19 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:20.177857 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-647a6e0b-eca9-497d-a789-9ecf6f579c70 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: .version_select at 0x7f524982ba60>, body: {"keypair": {"name": "tempest-keypair-595673043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtOSuse7cJ8aqMuVomvxbzvuKHPHNH3zMrV7H85DGquBwEoK3eE4RnxoUWmESaG2O99u5pdUvj9jxaNGto5Toh3F6qhn2++8vECQGBgmHgfskHVhtLv00mjnoXcHb2k1w=="}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:20.195533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-647a6e0b-eca9-497d-a789-9ecf6f579c70 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'key_pairs'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:35:20.197552 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-647a6e0b-eca9-497d-a789-9ecf6f579c70 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for user b2e09539caff4d4698cf29c1ea22d365 and project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'key_pairs'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:35:20.297847 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-647a6e0b-eca9-497d-a789-9ecf6f579c70 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124587 Jul 07 15:35:20.298481 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 132/254] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:35:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:35:20.386896 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:20.387504 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:20.394266 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:20.397040 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:20.397040 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:20.397040 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:20.531893 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:20.532448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:20.537650 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:20.540646 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:20.540646 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3ca36915-6328-4ff4-a96a-0f5683de64fd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.157843 Jul 07 15:35:20.541014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 123/255] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:20 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:20.622667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-03f5cd88-791d-4587-bf1c-cb22cf540c82 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:20.622667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-03f5cd88-791d-4587-bf1c-cb22cf540c82 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:20.629440 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03f5cd88-791d-4587-bf1c-cb22cf540c82 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:20.629887 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03f5cd88-791d-4587-bf1c-cb22cf540c82 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:20.630822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03f5cd88-791d-4587-bf1c-cb22cf540c82 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:20.631264 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03f5cd88-791d-4587-bf1c-cb22cf540c82 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:20.780918 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-03f5cd88-791d-4587-bf1c-cb22cf540c82 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:20.788890 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-03f5cd88-791d-4587-bf1c-cb22cf540c82 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.171694 Jul 07 15:35:20.789455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 133/256] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:20 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:21.560730 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:21.561420 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:21.582127 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:21.582577 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:21.583363 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:21.583847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:21.730831 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:21.743645 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:21.745196 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:21.746683 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-08e29d3e-fe02-4ff5-acc1-a2d21ff1284e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.190282 Jul 07 15:35:21.747286 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 124/257] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:21 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:21.807262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-315f2233-42d9-4332-b4da-0cb298055357 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:21.816050 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-315f2233-42d9-4332-b4da-0cb298055357 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:21.817496 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-315f2233-42d9-4332-b4da-0cb298055357 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:21.817946 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-315f2233-42d9-4332-b4da-0cb298055357 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:21.818886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-315f2233-42d9-4332-b4da-0cb298055357 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:21.819456 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-315f2233-42d9-4332-b4da-0cb298055357 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:21.965098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-315f2233-42d9-4332-b4da-0cb298055357 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:21.973407 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-315f2233-42d9-4332-b4da-0cb298055357 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.170773 Jul 07 15:35:21.974100 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 134/258] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:21 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:22.645252 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-762255211", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac1a0dbf-9ce9-4f3d-9709-351b088f4833"}], "security_groups": [{"name": "tempest-securitygroup--173316830"}], "key_name": "tempest-keypair-595673043", "user_data": "}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:22.749584 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] validate_networks() for [('ac1a0dbf-9ce9-4f3d-9709-351b088f4833', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:35:22.765669 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:22.766945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:22.773323 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:22.773767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:22.774527 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:22.775092 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:23.197310 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:23.205934 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:23.207521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:23.208718 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ae9de0c7-44b2-44e9-ae6e-4128b9c37cce tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.447264 Jul 07 15:35:23.209287 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 135/259] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:22 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:35:23.214193 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6072bed6-9887-4d65-baa7-a64b73cc1fe1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:23.215027 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6072bed6-9887-4d65-baa7-a64b73cc1fe1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:23.221784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6072bed6-9887-4d65-baa7-a64b73cc1fe1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:23.222731 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6072bed6-9887-4d65-baa7-a64b73cc1fe1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:23.223863 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6072bed6-9887-4d65-baa7-a64b73cc1fe1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:23.224540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6072bed6-9887-4d65-baa7-a64b73cc1fe1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:23.458555 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6072bed6-9887-4d65-baa7-a64b73cc1fe1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:23.468561 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6072bed6-9887-4d65-baa7-a64b73cc1fe1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.258286 Jul 07 15:35:23.469233 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 136/260] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:23 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:23.490822 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:35:23.491236 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:35:23.492443 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:35:23.493037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:35:23.493609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:35:23.505882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:23.507183 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:23.508447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:23.509064 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:23.536960 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:35:23.542928 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for user b2e09539caff4d4698cf29c1ea22d365 and project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:35:23.555699 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:35:23.558050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:35:23.711348 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-31094885-86fe-4568-8752-e7e088b447a2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.070289 Jul 07 15:35:23.712019 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 125/261] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:35:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:35:23.721704 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cdb5c35f-4c89-41bc-9041-827c718062f5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:23.722545 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cdb5c35f-4c89-41bc-9041-827c718062f5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:23.783358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cdb5c35f-4c89-41bc-9041-827c718062f5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:23.788275 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cdb5c35f-4c89-41bc-9041-827c718062f5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1240 microversion: 2.1 time: 0.070394 Jul 07 15:35:23.788846 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 137/262] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:23 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:24.227537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:24.228219 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:24.236299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:24.236752 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:24.237565 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:24.237999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:24.403784 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:24.413385 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:24.415217 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:24.416687 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-02a1146b-6322-49d1-a8df-fa8a2869d9ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.193439 Jul 07 15:35:24.417268 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 126/263] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:24 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:24.490334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d776e4be-d962-42ff-980f-45f61db25926 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:24.490848 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d776e4be-d962-42ff-980f-45f61db25926 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:24.497002 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d776e4be-d962-42ff-980f-45f61db25926 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:24.497457 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d776e4be-d962-42ff-980f-45f61db25926 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:24.498220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d776e4be-d962-42ff-980f-45f61db25926 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:24.498655 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d776e4be-d962-42ff-980f-45f61db25926 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:24.634841 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d776e4be-d962-42ff-980f-45f61db25926 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:24.643734 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d776e4be-d962-42ff-980f-45f61db25926 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.157282 Jul 07 15:35:24.644446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 138/264] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:24 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:24.805464 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c92fc774-abc9-4c4e-bab6-bed07e535d2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:24.805987 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c92fc774-abc9-4c4e-bab6-bed07e535d2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:24.812947 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c92fc774-abc9-4c4e-bab6-bed07e535d2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:24.813399 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c92fc774-abc9-4c4e-bab6-bed07e535d2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:24.814148 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c92fc774-abc9-4c4e-bab6-bed07e535d2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:24.814568 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c92fc774-abc9-4c4e-bab6-bed07e535d2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:24.881187 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c92fc774-abc9-4c4e-bab6-bed07e535d2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:24.888208 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c92fc774-abc9-4c4e-bab6-bed07e535d2a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.086699 Jul 07 15:35:24.888783 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 127/265] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:24 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:25.435838 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:25.436450 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:25.442394 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:25.442822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:25.443587 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:25.444538 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:25.589703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:25.600490 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:25.602235 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:25.603473 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-11a292dc-a653-4d73-8690-17f6df1e637a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.171742 Jul 07 15:35:25.604342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 139/266] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:25 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:25.661029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2bb322d1-aa7a-43c7-abed-87af748aa65e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:25.661642 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2bb322d1-aa7a-43c7-abed-87af748aa65e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:25.668107 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2bb322d1-aa7a-43c7-abed-87af748aa65e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:25.668560 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2bb322d1-aa7a-43c7-abed-87af748aa65e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:25.669338 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2bb322d1-aa7a-43c7-abed-87af748aa65e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:25.669768 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2bb322d1-aa7a-43c7-abed-87af748aa65e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:25.815364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2bb322d1-aa7a-43c7-abed-87af748aa65e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:25.823251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2bb322d1-aa7a-43c7-abed-87af748aa65e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.166659 Jul 07 15:35:25.823972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 128/267] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:25 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:25.905822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0c73d6d0-524c-4934-8fbd-ff8ad8480f6a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:25.907094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0c73d6d0-524c-4934-8fbd-ff8ad8480f6a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:25.913186 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0c73d6d0-524c-4934-8fbd-ff8ad8480f6a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:25.913963 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0c73d6d0-524c-4934-8fbd-ff8ad8480f6a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:25.914719 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0c73d6d0-524c-4934-8fbd-ff8ad8480f6a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:25.915152 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0c73d6d0-524c-4934-8fbd-ff8ad8480f6a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:25.978036 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0c73d6d0-524c-4934-8fbd-ff8ad8480f6a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:25.986213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0c73d6d0-524c-4934-8fbd-ff8ad8480f6a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.084234 Jul 07 15:35:25.986779 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 140/268] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:25 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:26.622250 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:26.623021 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:26.629140 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:26.629581 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:26.630328 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:26.630751 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:26.764933 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:26.773311 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:26.774811 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:26.775976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-25176473-1831-4ff0-b471-bbb631d06113 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.157696 Jul 07 15:35:26.776538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 129/269] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:26 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:26.841017 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c934c5da-b8d3-4dda-bc26-bbfcc959a388 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:26.841621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c934c5da-b8d3-4dda-bc26-bbfcc959a388 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:26.849357 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c934c5da-b8d3-4dda-bc26-bbfcc959a388 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:26.849806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c934c5da-b8d3-4dda-bc26-bbfcc959a388 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:26.850568 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c934c5da-b8d3-4dda-bc26-bbfcc959a388 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:26.850996 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c934c5da-b8d3-4dda-bc26-bbfcc959a388 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:26.990579 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c934c5da-b8d3-4dda-bc26-bbfcc959a388 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:26.998260 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c934c5da-b8d3-4dda-bc26-bbfcc959a388 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.160969 Jul 07 15:35:26.998823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 141/270] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:26 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:27.002685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0351e998-a490-47f8-b259-614b59f8ebd2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:27.003296 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0351e998-a490-47f8-b259-614b59f8ebd2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:27.010100 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0351e998-a490-47f8-b259-614b59f8ebd2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:27.013903 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0351e998-a490-47f8-b259-614b59f8ebd2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:27.013903 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0351e998-a490-47f8-b259-614b59f8ebd2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:27.013903 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0351e998-a490-47f8-b259-614b59f8ebd2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:27.074470 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0351e998-a490-47f8-b259-614b59f8ebd2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:27.082284 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0351e998-a490-47f8-b259-614b59f8ebd2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.083973 Jul 07 15:35:27.082844 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 130/271] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:26 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:27.405851 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-a6a503c0-96ea-47d1-85de-43ea511c44f5 req-dd76d3ea-8ae9-460b-bcdc-e6811cdec10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e85e6b3-ebad-441e-afcd-31692b27b782", "name": "network-vif-plugged", "status": "completed", "tag": "8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:27.414365 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-a6a503c0-96ea-47d1-85de-43ea511c44f5 req-dd76d3ea-8ae9-460b-bcdc-e6811cdec10e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:27.414800 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-a6a503c0-96ea-47d1-85de-43ea511c44f5 req-dd76d3ea-8ae9-460b-bcdc-e6811cdec10e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:27.426054 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-a6a503c0-96ea-47d1-85de-43ea511c44f5 req-dd76d3ea-8ae9-460b-bcdc-e6811cdec10e service nova] Creating event network-vif-plugged:8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a for instance 2e85e6b3-ebad-441e-afcd-31692b27b782 on hv-cinder-84130 Jul 07 15:35:27.430929 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-a6a503c0-96ea-47d1-85de-43ea511c44f5 req-dd76d3ea-8ae9-460b-bcdc-e6811cdec10e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028889 Jul 07 15:35:27.431502 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 142/272] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:35:27.794139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:27.794750 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:27.801456 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:27.801902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:27.802664 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:27.803103 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:27.940667 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:27.941570 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:27.943069 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:27.944244 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6e271afc-7ef9-423e-851f-a002bb8c8903 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.154041 Jul 07 15:35:27.944789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 131/273] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:27 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:28.016040 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-95253ddb-a2ae-4429-a441-fd6b26914e89 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:28.017242 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-95253ddb-a2ae-4429-a441-fd6b26914e89 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:28.023344 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-95253ddb-a2ae-4429-a441-fd6b26914e89 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:28.023888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-95253ddb-a2ae-4429-a441-fd6b26914e89 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:28.024641 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-95253ddb-a2ae-4429-a441-fd6b26914e89 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:28.025069 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-95253ddb-a2ae-4429-a441-fd6b26914e89 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:28.100367 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-bbfc9989-62fa-4bbc-abdd-89615f6d49cd tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:28.102359 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-bbfc9989-62fa-4bbc-abdd-89615f6d49cd tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:28.110642 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bbfc9989-62fa-4bbc-abdd-89615f6d49cd tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:28.111174 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bbfc9989-62fa-4bbc-abdd-89615f6d49cd tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:28.112042 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bbfc9989-62fa-4bbc-abdd-89615f6d49cd tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:28.112534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bbfc9989-62fa-4bbc-abdd-89615f6d49cd tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:28.181457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-bbfc9989-62fa-4bbc-abdd-89615f6d49cd tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:28.185828 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-95253ddb-a2ae-4429-a441-fd6b26914e89 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:28.188917 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-bbfc9989-62fa-4bbc-abdd-89615f6d49cd tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.094598 Jul 07 15:35:28.189496 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 132/274] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:28 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:28.193573 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-95253ddb-a2ae-4429-a441-fd6b26914e89 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.181718 Jul 07 15:35:28.194448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 143/275] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:28 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:28.963007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:28.963523 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:28.969623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:28.970771 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:28.971527 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:28.971985 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:29.101270 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:29.109808 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:29.111353 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:29.112532 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c3b7561a-5318-46eb-8d1c-b43369bdb6d7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.153555 Jul 07 15:35:29.113086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 133/276] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:28 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:29.207076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a8fd7d55-e6cd-435b-b71c-ec939c467d28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:29.207793 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a8fd7d55-e6cd-435b-b71c-ec939c467d28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:29.210417 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-961fecfe-9c86-496a-bb63-7d4718a40dff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:29.211045 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-961fecfe-9c86-496a-bb63-7d4718a40dff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:29.214428 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a8fd7d55-e6cd-435b-b71c-ec939c467d28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:29.214811 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a8fd7d55-e6cd-435b-b71c-ec939c467d28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:29.215589 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a8fd7d55-e6cd-435b-b71c-ec939c467d28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:29.216030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a8fd7d55-e6cd-435b-b71c-ec939c467d28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:29.216976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-961fecfe-9c86-496a-bb63-7d4718a40dff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:29.217417 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-961fecfe-9c86-496a-bb63-7d4718a40dff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:29.218163 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-961fecfe-9c86-496a-bb63-7d4718a40dff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:29.218588 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-961fecfe-9c86-496a-bb63-7d4718a40dff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:29.298872 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a8fd7d55-e6cd-435b-b71c-ec939c467d28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:29.306268 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a8fd7d55-e6cd-435b-b71c-ec939c467d28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.103770 Jul 07 15:35:29.306869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 144/277] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:29 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:29.366406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-961fecfe-9c86-496a-bb63-7d4718a40dff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:29.374101 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-961fecfe-9c86-496a-bb63-7d4718a40dff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.167405 Jul 07 15:35:29.377155 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 134/278] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:29 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:30.130626 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:30.131170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:30.137188 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:30.137636 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:30.138388 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:30.138819 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:30.268893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:30.276737 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:30.278251 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:30.279394 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c56c4d70-9d09-4cec-b513-7fb13a90199d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.152714 Jul 07 15:35:30.279981 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 145/279] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:30 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:30.323452 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5b45d6b3-7b66-4a5e-8b48-d013fa5670d9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:30.324093 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5b45d6b3-7b66-4a5e-8b48-d013fa5670d9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:30.330598 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5b45d6b3-7b66-4a5e-8b48-d013fa5670d9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:30.331046 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5b45d6b3-7b66-4a5e-8b48-d013fa5670d9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:30.331836 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5b45d6b3-7b66-4a5e-8b48-d013fa5670d9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:30.332267 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5b45d6b3-7b66-4a5e-8b48-d013fa5670d9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:30.392053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-69dc0671-0b32-4637-a524-7ebab93a8c28 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:30.392053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-69dc0671-0b32-4637-a524-7ebab93a8c28 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:30.392955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-5b45d6b3-7b66-4a5e-8b48-d013fa5670d9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:30.397771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-69dc0671-0b32-4637-a524-7ebab93a8c28 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:30.398215 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-69dc0671-0b32-4637-a524-7ebab93a8c28 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:30.398996 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-69dc0671-0b32-4637-a524-7ebab93a8c28 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:30.399642 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-69dc0671-0b32-4637-a524-7ebab93a8c28 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:30.400910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5b45d6b3-7b66-4a5e-8b48-d013fa5670d9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.081224 Jul 07 15:35:30.401480 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 135/280] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:30 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:30.540334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-69dc0671-0b32-4637-a524-7ebab93a8c28 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:30.548407 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-69dc0671-0b32-4637-a524-7ebab93a8c28 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.160553 Jul 07 15:35:30.548968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 146/281] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:30 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:31.299098 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:31.299889 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:31.306085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:31.306518 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:31.307261 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:31.307718 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:31.417371 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4cf659f9-9c1e-4f23-8233-ae6410dba81a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:31.418077 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4cf659f9-9c1e-4f23-8233-ae6410dba81a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:31.425147 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4cf659f9-9c1e-4f23-8233-ae6410dba81a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:31.425689 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4cf659f9-9c1e-4f23-8233-ae6410dba81a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:31.426641 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4cf659f9-9c1e-4f23-8233-ae6410dba81a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:31.427888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4cf659f9-9c1e-4f23-8233-ae6410dba81a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:31.443302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:31.451368 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:31.452907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:31.454083 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a8b17ce2-96ed-4fab-ae13-c010aa9fe03e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.160067 Jul 07 15:35:31.454635 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 136/282] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:31 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:31.489466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4cf659f9-9c1e-4f23-8233-ae6410dba81a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:31.496928 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4cf659f9-9c1e-4f23-8233-ae6410dba81a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.084064 Jul 07 15:35:31.497489 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 147/283] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:31 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:31.565290 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-057b580e-3abb-4aca-ac08-c4220d93d432 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:31.565897 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-057b580e-3abb-4aca-ac08-c4220d93d432 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:31.575378 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-057b580e-3abb-4aca-ac08-c4220d93d432 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:31.575848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-057b580e-3abb-4aca-ac08-c4220d93d432 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:31.576605 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-057b580e-3abb-4aca-ac08-c4220d93d432 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:31.577036 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-057b580e-3abb-4aca-ac08-c4220d93d432 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:31.705455 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-057b580e-3abb-4aca-ac08-c4220d93d432 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:31.712841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-057b580e-3abb-4aca-ac08-c4220d93d432 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.151689 Jul 07 15:35:31.713408 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 137/284] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:31 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:32.472132 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:32.472808 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:32.479210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:32.480270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:32.481591 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:32.482319 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:32.513754 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e695e9ca-814e-49cc-b9cd-21a6d0c6d61f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:32.514272 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e695e9ca-814e-49cc-b9cd-21a6d0c6d61f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:32.520766 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e695e9ca-814e-49cc-b9cd-21a6d0c6d61f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:32.521207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e695e9ca-814e-49cc-b9cd-21a6d0c6d61f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:32.522115 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e695e9ca-814e-49cc-b9cd-21a6d0c6d61f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:32.522394 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e695e9ca-814e-49cc-b9cd-21a6d0c6d61f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:32.600288 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e695e9ca-814e-49cc-b9cd-21a6d0c6d61f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:32.608030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e695e9ca-814e-49cc-b9cd-21a6d0c6d61f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.098148 Jul 07 15:35:32.608911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 138/285] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:32 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:32.630450 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:32.638328 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:32.639838 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:32.640967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9e91555d-441c-408c-967f-025d7cb77c7a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.172670 Jul 07 15:35:32.641515 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 148/286] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:32 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:32.729552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5ce3ec57-da66-454c-aaa4-cfc7f3b8eab0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:32.730406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5ce3ec57-da66-454c-aaa4-cfc7f3b8eab0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:32.736435 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ce3ec57-da66-454c-aaa4-cfc7f3b8eab0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:32.736880 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ce3ec57-da66-454c-aaa4-cfc7f3b8eab0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:32.737637 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ce3ec57-da66-454c-aaa4-cfc7f3b8eab0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:32.738077 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ce3ec57-da66-454c-aaa4-cfc7f3b8eab0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:32.867392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-5ce3ec57-da66-454c-aaa4-cfc7f3b8eab0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:32.875080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5ce3ec57-da66-454c-aaa4-cfc7f3b8eab0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.149343 Jul 07 15:35:32.875672 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 139/287] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:32 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:33.624468 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1b5bc476-a618-4318-ba18-309a53f74961 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:33.625076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1b5bc476-a618-4318-ba18-309a53f74961 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:33.631738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b5bc476-a618-4318-ba18-309a53f74961 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:33.632182 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b5bc476-a618-4318-ba18-309a53f74961 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:33.632984 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b5bc476-a618-4318-ba18-309a53f74961 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:33.633412 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b5bc476-a618-4318-ba18-309a53f74961 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:33.658261 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:33.659064 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:33.661427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:33.662266 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=6 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:33.667015 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:33.667457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:33.668260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:33.668713 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:33.693540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1b5bc476-a618-4318-ba18-309a53f74961 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:33.701147 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1b5bc476-a618-4318-ba18-309a53f74961 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.080481 Jul 07 15:35:33.701761 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 149/288] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:33 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:33.796680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:33.804536 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:33.806044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:33.807185 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ac9a3ee2-1624-408a-8d82-b08c05e28701 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.152885 Jul 07 15:35:33.807781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 140/289] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:33 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:35:33.892648 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fcbf17d7-2be6-4de8-b9eb-b8604d78c0db tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:33.892900 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fcbf17d7-2be6-4de8-b9eb-b8604d78c0db tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:33.894844 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=6 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:33.899954 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcbf17d7-2be6-4de8-b9eb-b8604d78c0db tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:33.900446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcbf17d7-2be6-4de8-b9eb-b8604d78c0db tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:33.901178 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcbf17d7-2be6-4de8-b9eb-b8604d78c0db tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:33.901600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcbf17d7-2be6-4de8-b9eb-b8604d78c0db tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:33.916344 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:34.031947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-fcbf17d7-2be6-4de8-b9eb-b8604d78c0db tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:34.039457 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fcbf17d7-2be6-4de8-b9eb-b8604d78c0db tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.151627 Jul 07 15:35:34.040125 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 150/290] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:33 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:34.718123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-af7d7b9f-426c-49b8-9ade-91fe825824fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:34.718727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-af7d7b9f-426c-49b8-9ade-91fe825824fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:34.725183 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af7d7b9f-426c-49b8-9ade-91fe825824fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:34.725621 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af7d7b9f-426c-49b8-9ade-91fe825824fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:34.726372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af7d7b9f-426c-49b8-9ade-91fe825824fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:34.726803 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af7d7b9f-426c-49b8-9ade-91fe825824fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:34.730927 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:34.786658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-af7d7b9f-426c-49b8-9ade-91fe825824fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:34.794010 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-af7d7b9f-426c-49b8-9ade-91fe825824fb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.079787 Jul 07 15:35:34.794570 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 141/291] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:34 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:34.825494 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:34.826094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:34.832025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:34.832471 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:34.833221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:34.833647 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:34.958660 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:34.966650 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:34.968040 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:34.969172 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-834a21e4-fa63-4aa9-ac29-03e48c9480c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.147490 Jul 07 15:35:34.969788 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 151/292] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:34 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:35.056898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c2aa75f5-9fdf-452b-8394-1e1e8c13f50a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:35.057507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c2aa75f5-9fdf-452b-8394-1e1e8c13f50a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:35.063489 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c2aa75f5-9fdf-452b-8394-1e1e8c13f50a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:35.063966 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c2aa75f5-9fdf-452b-8394-1e1e8c13f50a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:35.064732 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c2aa75f5-9fdf-452b-8394-1e1e8c13f50a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:35.065165 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c2aa75f5-9fdf-452b-8394-1e1e8c13f50a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:35.195671 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c2aa75f5-9fdf-452b-8394-1e1e8c13f50a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:35.203291 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c2aa75f5-9fdf-452b-8394-1e1e8c13f50a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.150199 Jul 07 15:35:35.203898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 142/293] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:35 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:35.810229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b0cb9ead-aefb-4bd2-bfbe-8d96ff3c3a02 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:35.810750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b0cb9ead-aefb-4bd2-bfbe-8d96ff3c3a02 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:35.817504 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b0cb9ead-aefb-4bd2-bfbe-8d96ff3c3a02 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:35.817937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b0cb9ead-aefb-4bd2-bfbe-8d96ff3c3a02 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:35.818678 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b0cb9ead-aefb-4bd2-bfbe-8d96ff3c3a02 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:35.819099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b0cb9ead-aefb-4bd2-bfbe-8d96ff3c3a02 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:35.878302 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b0cb9ead-aefb-4bd2-bfbe-8d96ff3c3a02 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:35.885467 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b0cb9ead-aefb-4bd2-bfbe-8d96ff3c3a02 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.079179 Jul 07 15:35:35.886024 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 152/294] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:35 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:35.987508 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:35.988160 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:35.994790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:35.995238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:35.996024 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:35.996457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:36.122877 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:36.131232 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:36.132764 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:36.133943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a976a467-0d27-4bc0-92fb-00e2ed7e8db7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.150285 Jul 07 15:35:36.134654 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 143/295] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:35 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:36.220141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f7466537-4018-4fb4-a026-e5bf6c21814f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:36.220743 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f7466537-4018-4fb4-a026-e5bf6c21814f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:36.227114 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f7466537-4018-4fb4-a026-e5bf6c21814f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:36.227591 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f7466537-4018-4fb4-a026-e5bf6c21814f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:36.228335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f7466537-4018-4fb4-a026-e5bf6c21814f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:36.228761 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f7466537-4018-4fb4-a026-e5bf6c21814f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:36.362568 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f7466537-4018-4fb4-a026-e5bf6c21814f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:36.370067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f7466537-4018-4fb4-a026-e5bf6c21814f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.154139 Jul 07 15:35:36.370624 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 153/296] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:36 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:36.903027 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-eb616d72-d0aa-4a74-9068-3f2738caf008 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:36.903557 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-eb616d72-d0aa-4a74-9068-3f2738caf008 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:36.905431 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:36.910690 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-eb616d72-d0aa-4a74-9068-3f2738caf008 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:36.911131 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-eb616d72-d0aa-4a74-9068-3f2738caf008 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:36.911918 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-eb616d72-d0aa-4a74-9068-3f2738caf008 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:36.912345 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-eb616d72-d0aa-4a74-9068-3f2738caf008 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:36.973167 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-eb616d72-d0aa-4a74-9068-3f2738caf008 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:36.980612 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-eb616d72-d0aa-4a74-9068-3f2738caf008 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.081511 Jul 07 15:35:36.981168 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 144/297] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:36 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:37.152414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:37.153008 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:37.154947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:37.160199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:37.160635 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:37.161429 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:37.161848 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:37.289323 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:37.297172 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:37.298685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:37.299883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8d019cbc-3c7b-4911-84b7-46f7c9f88dd8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.151256 Jul 07 15:35:37.300442 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 154/298] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:37 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:37.387290 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1f57d5cc-a9e3-4a59-8eb7-5b13dda01312 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:37.387909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1f57d5cc-a9e3-4a59-8eb7-5b13dda01312 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:37.394846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1f57d5cc-a9e3-4a59-8eb7-5b13dda01312 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:37.395282 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1f57d5cc-a9e3-4a59-8eb7-5b13dda01312 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:37.396072 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1f57d5cc-a9e3-4a59-8eb7-5b13dda01312 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:37.396498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1f57d5cc-a9e3-4a59-8eb7-5b13dda01312 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:37.528003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1f57d5cc-a9e3-4a59-8eb7-5b13dda01312 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:37.535295 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1f57d5cc-a9e3-4a59-8eb7-5b13dda01312 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.151845 Jul 07 15:35:37.535992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 145/299] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:37 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:37.997104 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-30c7ff89-8fba-43bd-86a9-3c376df39dd0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:37.997680 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-30c7ff89-8fba-43bd-86a9-3c376df39dd0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:38.004269 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30c7ff89-8fba-43bd-86a9-3c376df39dd0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:38.004716 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30c7ff89-8fba-43bd-86a9-3c376df39dd0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:38.005475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30c7ff89-8fba-43bd-86a9-3c376df39dd0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:38.005905 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30c7ff89-8fba-43bd-86a9-3c376df39dd0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:38.065555 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-30c7ff89-8fba-43bd-86a9-3c376df39dd0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:38.072856 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-30c7ff89-8fba-43bd-86a9-3c376df39dd0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.079627 Jul 07 15:35:38.073417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 155/300] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:37 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:38.317905 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:38.318508 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:38.324572 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:38.325014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:38.325771 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:38.326203 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:38.458213 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:38.466520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:38.468083 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:38.469804 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3eebdf9c-00ad-4f25-9aa2-772a3c2be6c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.155250 Jul 07 15:35:38.470383 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 146/301] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:38 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:38.552082 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bf71836c-668c-4fbf-ade6-ff1d3ee8ef2c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:38.552766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bf71836c-668c-4fbf-ade6-ff1d3ee8ef2c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:38.558897 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bf71836c-668c-4fbf-ade6-ff1d3ee8ef2c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:38.559455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bf71836c-668c-4fbf-ade6-ff1d3ee8ef2c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:38.560314 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bf71836c-668c-4fbf-ade6-ff1d3ee8ef2c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:38.560745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bf71836c-668c-4fbf-ade6-ff1d3ee8ef2c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:38.693367 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bf71836c-668c-4fbf-ade6-ff1d3ee8ef2c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:38.700797 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bf71836c-668c-4fbf-ade6-ff1d3ee8ef2c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.152847 Jul 07 15:35:38.701364 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 156/302] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:38 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:39.090780 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d0d08b92-58b6-43a1-8c70-78ddce90b1d2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:39.091392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d0d08b92-58b6-43a1-8c70-78ddce90b1d2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:39.097994 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0d08b92-58b6-43a1-8c70-78ddce90b1d2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:39.098444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0d08b92-58b6-43a1-8c70-78ddce90b1d2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:39.099211 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0d08b92-58b6-43a1-8c70-78ddce90b1d2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:39.099668 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0d08b92-58b6-43a1-8c70-78ddce90b1d2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:39.163943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d0d08b92-58b6-43a1-8c70-78ddce90b1d2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:39.171351 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d0d08b92-58b6-43a1-8c70-78ddce90b1d2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1244 microversion: 2.1 time: 0.085290 Jul 07 15:35:39.171945 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 147/303] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:39 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:39.488483 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:39.489081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:39.495643 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:39.496098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:39.496865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:39.497699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:39.633277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:39.650446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:39.650446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:39.650446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2529067d-5c9e-48e9-b570-76e7ea8d067d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.162338 Jul 07 15:35:39.650718 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 157/304] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:39 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:39.717901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f6a84608-e8db-4320-b9b7-8649d52ddaeb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:39.718569 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f6a84608-e8db-4320-b9b7-8649d52ddaeb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:39.725541 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f6a84608-e8db-4320-b9b7-8649d52ddaeb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:39.725983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f6a84608-e8db-4320-b9b7-8649d52ddaeb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:39.726738 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f6a84608-e8db-4320-b9b7-8649d52ddaeb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:39.727169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f6a84608-e8db-4320-b9b7-8649d52ddaeb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:39.861958 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f6a84608-e8db-4320-b9b7-8649d52ddaeb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:39.870396 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f6a84608-e8db-4320-b9b7-8649d52ddaeb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.156276 Jul 07 15:35:39.870958 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 148/305] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:39 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:40.189260 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3f5580e5-b12d-4b70-92e0-7766e0a8b411 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:40.190112 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3f5580e5-b12d-4b70-92e0-7766e0a8b411 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:40.197316 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f5580e5-b12d-4b70-92e0-7766e0a8b411 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:40.197798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f5580e5-b12d-4b70-92e0-7766e0a8b411 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:40.198544 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f5580e5-b12d-4b70-92e0-7766e0a8b411 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:40.198972 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f5580e5-b12d-4b70-92e0-7766e0a8b411 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:40.261189 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3f5580e5-b12d-4b70-92e0-7766e0a8b411 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:40.269422 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3f5580e5-b12d-4b70-92e0-7766e0a8b411 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1236 microversion: 2.1 time: 0.084422 Jul 07 15:35:40.269990 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 158/306] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:40 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:40.670206 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:40.670806 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:40.677015 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:40.682573 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:40.682573 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:40.682573 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:40.808836 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:40.816810 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:40.818424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:40.820322 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-aebc3681-2463-4d5e-a7c8-c9ee333d9d5e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1744 microversion: 2.20 time: 0.153869 Jul 07 15:35:40.820880 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 149/307] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:40 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:40.887462 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-304f2071-b7e0-4965-a61e-4cbbb3eb4516 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:40.888196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-304f2071-b7e0-4965-a61e-4cbbb3eb4516 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:40.894731 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-304f2071-b7e0-4965-a61e-4cbbb3eb4516 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:40.901859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-304f2071-b7e0-4965-a61e-4cbbb3eb4516 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:40.901859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-304f2071-b7e0-4965-a61e-4cbbb3eb4516 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:40.901859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-304f2071-b7e0-4965-a61e-4cbbb3eb4516 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:41.035832 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-304f2071-b7e0-4965-a61e-4cbbb3eb4516 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:41.043533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-304f2071-b7e0-4965-a61e-4cbbb3eb4516 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1519 microversion: 2.1 time: 0.160086 Jul 07 15:35:41.044097 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 159/308] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:40 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:41.289250 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-227bf3c8-a86b-4ef7-a47b-d0ccb0455ff6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:41.289850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-227bf3c8-a86b-4ef7-a47b-d0ccb0455ff6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:41.296079 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-227bf3c8-a86b-4ef7-a47b-d0ccb0455ff6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:41.296510 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-227bf3c8-a86b-4ef7-a47b-d0ccb0455ff6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:41.297887 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-227bf3c8-a86b-4ef7-a47b-d0ccb0455ff6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:41.298314 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-227bf3c8-a86b-4ef7-a47b-d0ccb0455ff6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:41.361410 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-227bf3c8-a86b-4ef7-a47b-d0ccb0455ff6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:41.369053 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-227bf3c8-a86b-4ef7-a47b-d0ccb0455ff6 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1292 microversion: 2.1 time: 0.083701 Jul 07 15:35:41.369675 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 150/309] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:41 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:41.509991 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e6838101-7e38-459f-98e6-1c1a0e5bf838 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:41.516763 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e6838101-7e38-459f-98e6-1c1a0e5bf838 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:41.517200 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e6838101-7e38-459f-98e6-1c1a0e5bf838 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:41.575301 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e6838101-7e38-459f-98e6-1c1a0e5bf838 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Going to try to stop instance {{(pid=124719) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 07 15:35:41.799811 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e6838101-7e38-459f-98e6-1c1a0e5bf838 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/action" status: 202 len: 0 microversion: 2.1 time: 0.293435 Jul 07 15:35:41.801661 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 160/310] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:35:41 2022] POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:35:41.808353 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6eba0ff5-2c35-4d62-81e4-c43c2fa671dd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:41.808967 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6eba0ff5-2c35-4d62-81e4-c43c2fa671dd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:41.816050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6eba0ff5-2c35-4d62-81e4-c43c2fa671dd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:41.816500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6eba0ff5-2c35-4d62-81e4-c43c2fa671dd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:41.817268 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6eba0ff5-2c35-4d62-81e4-c43c2fa671dd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:41.817704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6eba0ff5-2c35-4d62-81e4-c43c2fa671dd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:41.842550 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:41.843266 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:41.849787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:41.850228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:41.853941 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:41.853941 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:42.033776 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6eba0ff5-2c35-4d62-81e4-c43c2fa671dd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:42.042146 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6eba0ff5-2c35-4d62-81e4-c43c2fa671dd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.237548 Jul 07 15:35:42.042728 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 151/311] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:41 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:42.051452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:42.060575 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-95b25d73-ac5f-442b-80fb-3a5a1beeb0e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:42.061158 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:42.061295 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-95b25d73-ac5f-442b-80fb-3a5a1beeb0e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:42.062677 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:42.064464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c7b47410-abc1-43b8-bc45-ea6a91016751 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.225722 Jul 07 15:35:42.065028 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 161/312] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:41 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:42.068293 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-95b25d73-ac5f-442b-80fb-3a5a1beeb0e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:42.068738 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-95b25d73-ac5f-442b-80fb-3a5a1beeb0e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:42.069504 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-95b25d73-ac5f-442b-80fb-3a5a1beeb0e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:42.069936 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-95b25d73-ac5f-442b-80fb-3a5a1beeb0e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:42.218661 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-95b25d73-ac5f-442b-80fb-3a5a1beeb0e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:42.228748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-95b25d73-ac5f-442b-80fb-3a5a1beeb0e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1499 microversion: 2.1 time: 0.172008 Jul 07 15:35:42.229353 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 152/313] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:42 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:42.247234 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d70b390e-cefb-4d2c-a611-66c00b35b5b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:42.255993 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d70b390e-cefb-4d2c-a611-66c00b35b5b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:42.263889 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d70b390e-cefb-4d2c-a611-66c00b35b5b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:42.264750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d70b390e-cefb-4d2c-a611-66c00b35b5b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:42.285811 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d70b390e-cefb-4d2c-a611-66c00b35b5b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:42.289842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d70b390e-cefb-4d2c-a611-66c00b35b5b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:42.386831 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f4d58884-e94c-4e9e-ab46-5b1e39ba25d8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:42.387453 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f4d58884-e94c-4e9e-ab46-5b1e39ba25d8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:42.398574 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4d58884-e94c-4e9e-ab46-5b1e39ba25d8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:42.399032 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4d58884-e94c-4e9e-ab46-5b1e39ba25d8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:42.399876 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4d58884-e94c-4e9e-ab46-5b1e39ba25d8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:42.401468 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4d58884-e94c-4e9e-ab46-5b1e39ba25d8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:42.506599 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f4d58884-e94c-4e9e-ab46-5b1e39ba25d8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:42.518602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f4d58884-e94c-4e9e-ab46-5b1e39ba25d8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1300 microversion: 2.1 time: 0.136001 Jul 07 15:35:42.519203 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 153/314] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:42 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1300 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:42.547607 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d70b390e-cefb-4d2c-a611-66c00b35b5b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:42.557294 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d70b390e-cefb-4d2c-a611-66c00b35b5b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1515 microversion: 2.1 time: 0.315144 Jul 07 15:35:42.558520 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 162/315] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:42 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:43.069812 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ff3ec85a-7f96-457f-9cf0-7749ebba3196 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:43.071015 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ff3ec85a-7f96-457f-9cf0-7749ebba3196 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:43.083474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:43.084289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:43.085197 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ff3ec85a-7f96-457f-9cf0-7749ebba3196 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:43.088188 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ff3ec85a-7f96-457f-9cf0-7749ebba3196 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:43.111730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:43.115461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:43.116679 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:43.117469 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:43.119702 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ff3ec85a-7f96-457f-9cf0-7749ebba3196 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:43.120327 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ff3ec85a-7f96-457f-9cf0-7749ebba3196 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:43.412125 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ff3ec85a-7f96-457f-9cf0-7749ebba3196 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:43.435400 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ff3ec85a-7f96-457f-9cf0-7749ebba3196 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.359155 Jul 07 15:35:43.451205 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 154/316] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:43 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:43.508906 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:43.517111 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:43.519021 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:43.529159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a4c2ca0b-599d-44cd-8bb2-9e2f49636732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.450752 Jul 07 15:35:43.536408 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-55947365-8da7-46c4-8a4c-7ae91ecdf3af tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:43.537102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-55947365-8da7-46c4-8a4c-7ae91ecdf3af tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:43.541102 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 163/317] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:43 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:35:43.544725 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55947365-8da7-46c4-8a4c-7ae91ecdf3af tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:43.545395 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55947365-8da7-46c4-8a4c-7ae91ecdf3af tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:43.546384 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55947365-8da7-46c4-8a4c-7ae91ecdf3af tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:43.549858 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55947365-8da7-46c4-8a4c-7ae91ecdf3af tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:43.746913 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-55947365-8da7-46c4-8a4c-7ae91ecdf3af tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:43.758513 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-55947365-8da7-46c4-8a4c-7ae91ecdf3af tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1365 microversion: 2.1 time: 0.225910 Jul 07 15:35:43.769898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 155/318] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:43 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:44.455288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5f8e9acf-fe6c-4c21-b478-291fb03f686e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:44.456136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5f8e9acf-fe6c-4c21-b478-291fb03f686e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:44.464825 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f8e9acf-fe6c-4c21-b478-291fb03f686e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:44.468401 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f8e9acf-fe6c-4c21-b478-291fb03f686e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:44.469568 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f8e9acf-fe6c-4c21-b478-291fb03f686e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:44.473616 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5f8e9acf-fe6c-4c21-b478-291fb03f686e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:44.560014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:44.561953 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:44.598768 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:44.598768 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:44.598768 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:44.598768 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:44.912489 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5f8e9acf-fe6c-4c21-b478-291fb03f686e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:44.921529 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5f8e9acf-fe6c-4c21-b478-291fb03f686e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.470772 Jul 07 15:35:44.941283 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 164/319] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:44 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:44.947964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-04685f83-5f31-4992-8138-088effebd1b5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:44.951087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-04685f83-5f31-4992-8138-088effebd1b5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:44.969546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-04685f83-5f31-4992-8138-088effebd1b5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:44.969546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-04685f83-5f31-4992-8138-088effebd1b5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:44.969546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-04685f83-5f31-4992-8138-088effebd1b5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:44.970310 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-04685f83-5f31-4992-8138-088effebd1b5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:44.985319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:45.018672 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:45.020589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:45.021994 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-72802185-1a44-445d-8bcd-2c1f729bb7ef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.472174 Jul 07 15:35:45.023760 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 156/320] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:44 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:45.041867 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-38cce405-a6d7-4772-91b1-d460e008f406 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:45.043194 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-38cce405-a6d7-4772-91b1-d460e008f406 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:45.061342 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-38cce405-a6d7-4772-91b1-d460e008f406 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:45.064314 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-38cce405-a6d7-4772-91b1-d460e008f406 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:45.064314 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-38cce405-a6d7-4772-91b1-d460e008f406 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:45.064314 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-38cce405-a6d7-4772-91b1-d460e008f406 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:45.105993 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-38cce405-a6d7-4772-91b1-d460e008f406 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lazy-loading 'flavor' on Instance uuid 73c2472d-0015-49d1-ab4c-7eb597cbaa69 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:35:45.111475 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:45.200447 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-04685f83-5f31-4992-8138-088effebd1b5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:45.209627 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-04685f83-5f31-4992-8138-088effebd1b5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1365 microversion: 2.1 time: 0.276921 Jul 07 15:35:45.210764 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 165/321] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:44 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:45.215670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-bedce2c5-f82f-46f2-b9bd-e454ea883a5c req-fe4e00f0-3d7b-4057-8c7f-d38cd1df1f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "004cd795-a6e3-47b5-ba46-8f24751e8ec2", "tag": "0af4a4b2-ec67-4920-a522-06b353a6ccc2"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:45.224975 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-bedce2c5-f82f-46f2-b9bd-e454ea883a5c req-fe4e00f0-3d7b-4057-8c7f-d38cd1df1f4e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:45.225745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-bedce2c5-f82f-46f2-b9bd-e454ea883a5c req-fe4e00f0-3d7b-4057-8c7f-d38cd1df1f4e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:45.230362 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:45.238602 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-bedce2c5-f82f-46f2-b9bd-e454ea883a5c req-fe4e00f0-3d7b-4057-8c7f-d38cd1df1f4e service nova] Creating event network-changed:0af4a4b2-ec67-4920-a522-06b353a6ccc2 for instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 on hv-cinder-84130 Jul 07 15:35:45.243702 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-bedce2c5-f82f-46f2-b9bd-e454ea883a5c req-fe4e00f0-3d7b-4057-8c7f-d38cd1df1f4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031505 Jul 07 15:35:45.244936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 166/322] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:35:45.542767 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-38cce405-a6d7-4772-91b1-d460e008f406 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69/action" status: 200 len: 32 microversion: 2.1 time: 0.517501 Jul 07 15:35:45.545901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 157/323] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:35:45 2022] POST /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69/action => generated 32 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:35:45.564887 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2d4814d8-7b64-4ec5-8df2-9643cdb06073 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:45.570514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2d4814d8-7b64-4ec5-8df2-9643cdb06073 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:45.578385 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d4814d8-7b64-4ec5-8df2-9643cdb06073 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:45.581651 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d4814d8-7b64-4ec5-8df2-9643cdb06073 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:45.582915 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d4814d8-7b64-4ec5-8df2-9643cdb06073 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:45.583352 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d4814d8-7b64-4ec5-8df2-9643cdb06073 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:45.729928 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2d4814d8-7b64-4ec5-8df2-9643cdb06073 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:45.738311 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2d4814d8-7b64-4ec5-8df2-9643cdb06073 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.189315 Jul 07 15:35:45.739115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 167/324] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:45 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:45.956840 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ab2c2707-f7d1-4936-b4b1-49ae1d23f208 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:45.957804 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ab2c2707-f7d1-4936-b4b1-49ae1d23f208 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:46.001623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ab2c2707-f7d1-4936-b4b1-49ae1d23f208 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:46.002193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ab2c2707-f7d1-4936-b4b1-49ae1d23f208 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:46.003261 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ab2c2707-f7d1-4936-b4b1-49ae1d23f208 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:46.003934 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ab2c2707-f7d1-4936-b4b1-49ae1d23f208 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:46.044922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:46.045861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:46.061805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:46.062597 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:46.065279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:46.065790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:46.311873 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ab2c2707-f7d1-4936-b4b1-49ae1d23f208 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:46.311873 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ab2c2707-f7d1-4936-b4b1-49ae1d23f208 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.331359 Jul 07 15:35:46.311873 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 158/325] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:45 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:46.311873 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-795b4f2b-9dbd-47e1-bd42-de8dcca71564 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:46.312364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-795b4f2b-9dbd-47e1-bd42-de8dcca71564 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:46.312364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-795b4f2b-9dbd-47e1-bd42-de8dcca71564 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:46.312364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-795b4f2b-9dbd-47e1-bd42-de8dcca71564 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:46.312364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-795b4f2b-9dbd-47e1-bd42-de8dcca71564 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:46.312716 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-795b4f2b-9dbd-47e1-bd42-de8dcca71564 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:46.312803 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:46.312803 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:46.313018 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:46.314649 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8f275a1d-fd6c-4a1e-8133-88d99b072a57 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.277485 Jul 07 15:35:46.315274 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 168/326] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:46 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:46.442294 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-795b4f2b-9dbd-47e1-bd42-de8dcca71564 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:46.449916 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-795b4f2b-9dbd-47e1-bd42-de8dcca71564 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1365 microversion: 2.1 time: 0.171807 Jul 07 15:35:46.450480 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 159/327] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:46 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:46.755605 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6d1dc573-fac6-4f93-8a3f-7db7db238d10 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:46.756353 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6d1dc573-fac6-4f93-8a3f-7db7db238d10 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:46.768773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d1dc573-fac6-4f93-8a3f-7db7db238d10 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:46.769210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d1dc573-fac6-4f93-8a3f-7db7db238d10 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:46.769987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d1dc573-fac6-4f93-8a3f-7db7db238d10 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:46.774783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d1dc573-fac6-4f93-8a3f-7db7db238d10 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:47.053762 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6d1dc573-fac6-4f93-8a3f-7db7db238d10 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:47.066727 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6d1dc573-fac6-4f93-8a3f-7db7db238d10 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.315314 Jul 07 15:35:47.084971 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 169/328] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:46 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:47.336293 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:47.338342 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9da76095-6ec1-4ede-855e-51779aeb2ec4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:47.340708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9da76095-6ec1-4ede-855e-51779aeb2ec4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:47.341355 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:47.362532 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:47.363367 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9da76095-6ec1-4ede-855e-51779aeb2ec4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:47.364798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9da76095-6ec1-4ede-855e-51779aeb2ec4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:47.365430 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:47.368331 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9da76095-6ec1-4ede-855e-51779aeb2ec4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:47.369298 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:47.370159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:47.370371 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9da76095-6ec1-4ede-855e-51779aeb2ec4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:47.684604 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:47.693545 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:47.700023 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:47.713700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f5b5aab5-6a6e-4aee-a71a-9758b7f43c6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.383952 Jul 07 15:35:47.732829 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 170/329] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:47 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:47.742856 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-58d2a7ab-dfd3-4ace-8272-a38538107cda tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:47.743488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-58d2a7ab-dfd3-4ace-8272-a38538107cda tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:47.760211 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9da76095-6ec1-4ede-855e-51779aeb2ec4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:47.792435 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9da76095-6ec1-4ede-855e-51779aeb2ec4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.467908 Jul 07 15:35:47.795190 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-58d2a7ab-dfd3-4ace-8272-a38538107cda tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:47.796274 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 160/330] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:47 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:47.796932 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-58d2a7ab-dfd3-4ace-8272-a38538107cda tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:47.798059 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-58d2a7ab-dfd3-4ace-8272-a38538107cda tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:47.800920 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-58d2a7ab-dfd3-4ace-8272-a38538107cda tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:48.079481 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-58d2a7ab-dfd3-4ace-8272-a38538107cda tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:48.085809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8f4b0bb6-b4f9-4a47-a840-56e34709283d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:48.086570 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8f4b0bb6-b4f9-4a47-a840-56e34709283d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:48.089388 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-58d2a7ab-dfd3-4ace-8272-a38538107cda tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1365 microversion: 2.1 time: 0.355136 Jul 07 15:35:48.090189 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 171/331] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:47 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:48.096194 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f4b0bb6-b4f9-4a47-a840-56e34709283d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:48.100643 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f4b0bb6-b4f9-4a47-a840-56e34709283d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:48.100643 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f4b0bb6-b4f9-4a47-a840-56e34709283d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:48.100643 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f4b0bb6-b4f9-4a47-a840-56e34709283d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:48.380305 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8f4b0bb6-b4f9-4a47-a840-56e34709283d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:48.389856 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8f4b0bb6-b4f9-4a47-a840-56e34709283d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.307871 Jul 07 15:35:48.390545 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 161/332] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:48 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:48.739379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:48.740188 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:48.746539 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:48.747281 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:48.748303 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:48.748819 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:48.820193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b18b7d2c-8bec-4981-ba57-e9b249c042b5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:48.820995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b18b7d2c-8bec-4981-ba57-e9b249c042b5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:48.832744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b18b7d2c-8bec-4981-ba57-e9b249c042b5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:48.833499 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b18b7d2c-8bec-4981-ba57-e9b249c042b5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:48.834519 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b18b7d2c-8bec-4981-ba57-e9b249c042b5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:48.834964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b18b7d2c-8bec-4981-ba57-e9b249c042b5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:49.001150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:49.013272 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:49.017749 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:49.020866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5afa2237-189d-472a-988c-4ee498944304 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.288364 Jul 07 15:35:49.021437 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 172/333] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:48 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:49.054376 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b18b7d2c-8bec-4981-ba57-e9b249c042b5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:49.063139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b18b7d2c-8bec-4981-ba57-e9b249c042b5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.251269 Jul 07 15:35:49.072894 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 162/334] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:48 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:49.111000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bb2e431d-0df8-48e3-8213-f3d0ce5b3bba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:49.112399 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bb2e431d-0df8-48e3-8213-f3d0ce5b3bba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:49.122027 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bb2e431d-0df8-48e3-8213-f3d0ce5b3bba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:49.122840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bb2e431d-0df8-48e3-8213-f3d0ce5b3bba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:49.124323 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bb2e431d-0df8-48e3-8213-f3d0ce5b3bba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:49.124915 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bb2e431d-0df8-48e3-8213-f3d0ce5b3bba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:49.298824 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bb2e431d-0df8-48e3-8213-f3d0ce5b3bba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:49.307186 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bb2e431d-0df8-48e3-8213-f3d0ce5b3bba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1365 microversion: 2.1 time: 0.200558 Jul 07 15:35:49.317139 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 173/335] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:49 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:49.408330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1c45b31c-890e-4028-8935-df338b887900 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:49.409530 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1c45b31c-890e-4028-8935-df338b887900 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:49.416411 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1c45b31c-890e-4028-8935-df338b887900 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:49.417134 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1c45b31c-890e-4028-8935-df338b887900 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:49.417962 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1c45b31c-890e-4028-8935-df338b887900 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:49.418577 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1c45b31c-890e-4028-8935-df338b887900 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:49.584912 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1c45b31c-890e-4028-8935-df338b887900 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:49.593112 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1c45b31c-890e-4028-8935-df338b887900 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.189171 Jul 07 15:35:49.595979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 163/336] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:49 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:49.661267 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-42d49884-e48e-4a78-a8ac-6df576c1a9f3 req-a97c9643-95d5-4222-b73b-eeb8afe38eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004cd795-a6e3-47b5-ba46-8f24751e8ec2", "name": "network-vif-plugged", "status": "completed", "tag": "0af4a4b2-ec67-4920-a522-06b353a6ccc2"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:49.672710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-42d49884-e48e-4a78-a8ac-6df576c1a9f3 req-a97c9643-95d5-4222-b73b-eeb8afe38eb9 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:49.674077 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-42d49884-e48e-4a78-a8ac-6df576c1a9f3 req-a97c9643-95d5-4222-b73b-eeb8afe38eb9 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:49.685643 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-42d49884-e48e-4a78-a8ac-6df576c1a9f3 req-a97c9643-95d5-4222-b73b-eeb8afe38eb9 service nova] Creating event network-vif-plugged:0af4a4b2-ec67-4920-a522-06b353a6ccc2 for instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 on hv-cinder-84130 Jul 07 15:35:49.691771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-42d49884-e48e-4a78-a8ac-6df576c1a9f3 req-a97c9643-95d5-4222-b73b-eeb8afe38eb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034276 Jul 07 15:35:49.696026 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 174/337] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:35:50.038803 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:50.039728 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:50.046050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:50.046508 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:50.047490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:50.048633 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:50.082118 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9d224615-933c-45df-8b41-d6908eb02995 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:50.083979 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9d224615-933c-45df-8b41-d6908eb02995 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:50.098265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d224615-933c-45df-8b41-d6908eb02995 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:50.099007 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d224615-933c-45df-8b41-d6908eb02995 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:50.102736 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d224615-933c-45df-8b41-d6908eb02995 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:50.103344 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d224615-933c-45df-8b41-d6908eb02995 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:50.470795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9d224615-933c-45df-8b41-d6908eb02995 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:50.478847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:50.479425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9d224615-933c-45df-8b41-d6908eb02995 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.401645 Jul 07 15:35:50.489643 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 175/338] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:50 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:50.491144 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:50.492848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:50.494127 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7a120058-7937-4115-8998-bb613a09b394 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.459249 Jul 07 15:35:50.495067 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 164/339] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:50 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:35:50.506160 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-82bec034-41d0-4d8d-900c-0296e4db8fa1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:50.506160 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-82bec034-41d0-4d8d-900c-0296e4db8fa1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:50.506160 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-82bec034-41d0-4d8d-900c-0296e4db8fa1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:50.506160 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-82bec034-41d0-4d8d-900c-0296e4db8fa1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:50.507248 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-82bec034-41d0-4d8d-900c-0296e4db8fa1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:50.507503 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-82bec034-41d0-4d8d-900c-0296e4db8fa1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:50.613332 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8acff08f-fd1a-4110-8391-1056d749d9da tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:50.613898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8acff08f-fd1a-4110-8391-1056d749d9da tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:50.619980 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8acff08f-fd1a-4110-8391-1056d749d9da tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:50.620423 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8acff08f-fd1a-4110-8391-1056d749d9da tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:50.621190 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8acff08f-fd1a-4110-8391-1056d749d9da tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:50.621615 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8acff08f-fd1a-4110-8391-1056d749d9da tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:50.660666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-82bec034-41d0-4d8d-900c-0296e4db8fa1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:50.668221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-82bec034-41d0-4d8d-900c-0296e4db8fa1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1365 microversion: 2.1 time: 0.177209 Jul 07 15:35:50.668787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 176/340] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:50 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:50.774114 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8acff08f-fd1a-4110-8391-1056d749d9da tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:50.781489 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8acff08f-fd1a-4110-8391-1056d749d9da tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.172884 Jul 07 15:35:50.782698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 165/341] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:50 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:51.500456 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8f511d4a-6975-46d4-9f4e-d951a6cf2c6d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:51.502399 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8f511d4a-6975-46d4-9f4e-d951a6cf2c6d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:51.511245 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f511d4a-6975-46d4-9f4e-d951a6cf2c6d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:51.512011 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f511d4a-6975-46d4-9f4e-d951a6cf2c6d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:51.513371 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f511d4a-6975-46d4-9f4e-d951a6cf2c6d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:51.513561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:51.514139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:51.514712 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f511d4a-6975-46d4-9f4e-d951a6cf2c6d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:51.528280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:51.537710 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:51.537710 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:51.537710 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:51.720734 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8f511d4a-6975-46d4-9f4e-d951a6cf2c6d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:51.737166 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8f511d4a-6975-46d4-9f4e-d951a6cf2c6d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.240826 Jul 07 15:35:51.747776 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 177/342] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:51 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:51.756428 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d3e150a3-91fc-4e81-b276-f4e4ac3b8ff1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:51.757044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d3e150a3-91fc-4e81-b276-f4e4ac3b8ff1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:51.765650 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3e150a3-91fc-4e81-b276-f4e4ac3b8ff1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:51.766271 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3e150a3-91fc-4e81-b276-f4e4ac3b8ff1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:51.767221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3e150a3-91fc-4e81-b276-f4e4ac3b8ff1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:51.767795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3e150a3-91fc-4e81-b276-f4e4ac3b8ff1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:51.807491 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:51.822258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:51.826618 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:51.828936 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b552be5f-6407-4fd6-92c8-726d0a7f3727 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.319725 Jul 07 15:35:51.839184 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 166/343] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:51 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:51.839184 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fa436351-d966-44ac-a8f5-246bc290c4eb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:51.839184 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fa436351-d966-44ac-a8f5-246bc290c4eb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:51.863197 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa436351-d966-44ac-a8f5-246bc290c4eb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:51.864088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa436351-d966-44ac-a8f5-246bc290c4eb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:51.865577 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa436351-d966-44ac-a8f5-246bc290c4eb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:51.866441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa436351-d966-44ac-a8f5-246bc290c4eb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:52.449817 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d3e150a3-91fc-4e81-b276-f4e4ac3b8ff1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:52.467060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d3e150a3-91fc-4e81-b276-f4e4ac3b8ff1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1365 microversion: 2.1 time: 0.727763 Jul 07 15:35:52.481921 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 178/344] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:51 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1365 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:52.510590 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fa436351-d966-44ac-a8f5-246bc290c4eb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:52.520152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fa436351-d966-44ac-a8f5-246bc290c4eb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.687736 Jul 07 15:35:52.520773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 167/345] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:51 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:52.755629 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d3977b91-a18f-4e6b-ac11-0bcd8441de07 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:52.756164 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d3977b91-a18f-4e6b-ac11-0bcd8441de07 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:52.768017 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3977b91-a18f-4e6b-ac11-0bcd8441de07 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:52.768384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3977b91-a18f-4e6b-ac11-0bcd8441de07 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:52.769347 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3977b91-a18f-4e6b-ac11-0bcd8441de07 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:52.770943 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3977b91-a18f-4e6b-ac11-0bcd8441de07 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:52.849221 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:52.849838 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:52.864800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:52.867255 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:52.867255 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:52.869129 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:53.035465 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d3977b91-a18f-4e6b-ac11-0bcd8441de07 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:53.051818 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d3977b91-a18f-4e6b-ac11-0bcd8441de07 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.296196 Jul 07 15:35:53.052968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 179/346] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:52 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:53.124834 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:53.136518 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:53.140287 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:53.141526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-41b002c5-c04f-4965-a6df-0c4a8b50644a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.296632 Jul 07 15:35:53.142100 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 168/347] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:52 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:53.494547 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4e3209a1-2948-4d16-aac3-41416d6c9e04 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:53.495181 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4e3209a1-2948-4d16-aac3-41416d6c9e04 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:53.505239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e3209a1-2948-4d16-aac3-41416d6c9e04 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:53.506613 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e3209a1-2948-4d16-aac3-41416d6c9e04 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:53.509307 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e3209a1-2948-4d16-aac3-41416d6c9e04 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:53.509903 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e3209a1-2948-4d16-aac3-41416d6c9e04 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:53.553589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a4b32ec2-3125-4876-8e4b-e00bcbb867c4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:53.553589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a4b32ec2-3125-4876-8e4b-e00bcbb867c4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:53.562954 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a4b32ec2-3125-4876-8e4b-e00bcbb867c4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:53.563845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a4b32ec2-3125-4876-8e4b-e00bcbb867c4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:53.565020 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a4b32ec2-3125-4876-8e4b-e00bcbb867c4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:53.565666 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a4b32ec2-3125-4876-8e4b-e00bcbb867c4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:53.858753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4e3209a1-2948-4d16-aac3-41416d6c9e04 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:53.870454 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4e3209a1-2948-4d16-aac3-41416d6c9e04 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1555 microversion: 2.1 time: 0.385019 Jul 07 15:35:53.871045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 180/348] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:53 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1555 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:53.886501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a4b32ec2-3125-4876-8e4b-e00bcbb867c4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:53.894759 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c0bdd7f0-0da5-485a-a270-4c156ae81fac tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:53.896739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a4b32ec2-3125-4876-8e4b-e00bcbb867c4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.361866 Jul 07 15:35:53.900348 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c0bdd7f0-0da5-485a-a270-4c156ae81fac tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:53.908444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 169/349] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:53 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:35:53.915277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c0bdd7f0-0da5-485a-a270-4c156ae81fac tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:53.915870 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c0bdd7f0-0da5-485a-a270-4c156ae81fac tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:53.916685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c0bdd7f0-0da5-485a-a270-4c156ae81fac tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:53.917124 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c0bdd7f0-0da5-485a-a270-4c156ae81fac tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:54.073337 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3ab2325d-a5b8-42b1-8076-36a31c5ed5c4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:54.074903 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3ab2325d-a5b8-42b1-8076-36a31c5ed5c4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:54.089774 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ab2325d-a5b8-42b1-8076-36a31c5ed5c4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:54.091928 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ab2325d-a5b8-42b1-8076-36a31c5ed5c4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:54.094270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c0bdd7f0-0da5-485a-a270-4c156ae81fac tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.211233 Jul 07 15:35:54.095994 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 181/350] 10.222.0.25 () {58 vars in 1274 bytes} [Thu Jul 7 15:35:53 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2/os-interface => generated 285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:35:54.102944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ab2325d-a5b8-42b1-8076-36a31c5ed5c4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:54.103739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ab2325d-a5b8-42b1-8076-36a31c5ed5c4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:54.159803 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:54.160735 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:54.168308 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:54.169067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:54.171744 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:54.171744 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:54.851099 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3ab2325d-a5b8-42b1-8076-36a31c5ed5c4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:54.869084 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3ab2325d-a5b8-42b1-8076-36a31c5ed5c4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.801067 Jul 07 15:35:54.879948 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 170/351] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:54 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:54.885352 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-317201429", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:54.926544 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:54.941642 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:54.946575 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:54.950128 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-21da7c67-2779-4563-9d5a-62a02a44de63 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.794411 Jul 07 15:35:54.957165 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 182/352] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:54 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:35:54.972795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fa9d2b0c-f2ea-4ee4-a36a-1d4a21755c50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:54.976290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fa9d2b0c-f2ea-4ee4-a36a-1d4a21755c50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:54.977612 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] validate_networks() for None {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:35:54.984356 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fa9d2b0c-f2ea-4ee4-a36a-1d4a21755c50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:54.985738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fa9d2b0c-f2ea-4ee4-a36a-1d4a21755c50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:54.986771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fa9d2b0c-f2ea-4ee4-a36a-1d4a21755c50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:54.987434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fa9d2b0c-f2ea-4ee4-a36a-1d4a21755c50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:55.852351 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-fa9d2b0c-f2ea-4ee4-a36a-1d4a21755c50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:55.861187 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fa9d2b0c-f2ea-4ee4-a36a-1d4a21755c50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.902104 Jul 07 15:35:55.870821 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 183/353] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:54 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:55.890636 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c711b998-03b4-4ef8-8a56-b71e592ad016 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:55.892480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c711b998-03b4-4ef8-8a56-b71e592ad016 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:55.903308 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c711b998-03b4-4ef8-8a56-b71e592ad016 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:55.904294 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c711b998-03b4-4ef8-8a56-b71e592ad016 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:55.905770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c711b998-03b4-4ef8-8a56-b71e592ad016 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:55.906633 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c711b998-03b4-4ef8-8a56-b71e592ad016 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:55.936881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:56.003995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:35:56.005018 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:35:56.005493 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:35:56.006074 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:35:56.006485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:35:56.021727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:56.022455 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:56.023432 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:56.023886 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:56.041090 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Getting quotas for project b42fb18bea524ba980012973ec2a9ee2. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:35:56.045609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Getting quotas for user 3256d562f0a64600baeb215ebff4190d and project b42fb18bea524ba980012973ec2a9ee2. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:35:56.060055 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:35:56.062364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:35:56.187357 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c711b998-03b4-4ef8-8a56-b71e592ad016 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:56.199233 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c711b998-03b4-4ef8-8a56-b71e592ad016 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.312691 Jul 07 15:35:56.205525 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 184/354] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:55 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:56.210391 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:56.210996 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:56.217125 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:56.217565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:56.218318 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:56.218745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:56.394977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fa6abfa4-68cc-4408-8b4d-f882a05fb5dc tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513383 Jul 07 15:35:56.396396 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 171/355] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:35:56.412274 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-614e9fa0-8e21-4040-b8a4-52577bfe392a tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:56.413293 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-614e9fa0-8e21-4040-b8a4-52577bfe392a tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:56.564028 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-614e9fa0-8e21-4040-b8a4-52577bfe392a tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:56.584773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-614e9fa0-8e21-4040-b8a4-52577bfe392a tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1214 microversion: 2.1 time: 0.180904 Jul 07 15:35:56.587255 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 172/356] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:56 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:56.671674 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:56.691222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:56.694673 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:56.695699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-63a2c112-593c-42e0-b4a1-19df79b2e59f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.489135 Jul 07 15:35:56.696457 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 185/357] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:56 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:56.880438 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f9ab4a49-a08d-4167-ab59-5d7e2833b4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:56.881562 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f9ab4a49-a08d-4167-ab59-5d7e2833b4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:56.898421 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9ab4a49-a08d-4167-ab59-5d7e2833b4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:56.898875 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9ab4a49-a08d-4167-ab59-5d7e2833b4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:56.899691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9ab4a49-a08d-4167-ab59-5d7e2833b4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:56.900132 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9ab4a49-a08d-4167-ab59-5d7e2833b4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:57.218548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d1e61521-4ce5-4017-9ff5-63c5d25c0e08 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:57.221019 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d1e61521-4ce5-4017-9ff5-63c5d25c0e08 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:57.230710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d1e61521-4ce5-4017-9ff5-63c5d25c0e08 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:57.242796 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d1e61521-4ce5-4017-9ff5-63c5d25c0e08 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:57.244215 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d1e61521-4ce5-4017-9ff5-63c5d25c0e08 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:57.245076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d1e61521-4ce5-4017-9ff5-63c5d25c0e08 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:57.346453 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f9ab4a49-a08d-4167-ab59-5d7e2833b4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:57.356065 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f9ab4a49-a08d-4167-ab59-5d7e2833b4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.481982 Jul 07 15:35:57.364783 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 173/358] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:56 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:57.647748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ad4f31bb-2483-4405-a469-abb0eec6971f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:57.647748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ad4f31bb-2483-4405-a469-abb0eec6971f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:57.780490 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d1e61521-4ce5-4017-9ff5-63c5d25c0e08 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:57.789294 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d1e61521-4ce5-4017-9ff5-63c5d25c0e08 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1720 microversion: 2.1 time: 0.574801 Jul 07 15:35:57.790104 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 186/359] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:57 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1720 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:57.794498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:57.795096 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:57.796651 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ad4f31bb-2483-4405-a469-abb0eec6971f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:57.801227 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:57.801895 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:57.802842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:57.803288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:57.806180 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ad4f31bb-2483-4405-a469-abb0eec6971f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1214 microversion: 2.1 time: 0.207268 Jul 07 15:35:57.807153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 174/360] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:57 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:57.983827 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-506f3b5f-a287-4d9e-bd97-1fda26b37f7d req-32150e73-efc7-4372-a1a6-b8f91f109d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "004cd795-a6e3-47b5-ba46-8f24751e8ec2", "tag": "0af4a4b2-ec67-4920-a522-06b353a6ccc2"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:57.998315 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-506f3b5f-a287-4d9e-bd97-1fda26b37f7d req-32150e73-efc7-4372-a1a6-b8f91f109d63 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:57.999109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-506f3b5f-a287-4d9e-bd97-1fda26b37f7d req-32150e73-efc7-4372-a1a6-b8f91f109d63 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:58.005096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:35:58.012131 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-506f3b5f-a287-4d9e-bd97-1fda26b37f7d req-32150e73-efc7-4372-a1a6-b8f91f109d63 service nova] Creating event network-changed:0af4a4b2-ec67-4920-a522-06b353a6ccc2 for instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 on hv-cinder-84130 Jul 07 15:35:58.018082 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-506f3b5f-a287-4d9e-bd97-1fda26b37f7d req-32150e73-efc7-4372-a1a6-b8f91f109d63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041374 Jul 07 15:35:58.019965 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 175/361] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:35:58.049327 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:58.064859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:58.070437 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:58.074622 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-13357fb6-d7b7-4254-a137-6059dbeea529 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1739 microversion: 2.20 time: 0.283635 Jul 07 15:35:58.079184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 187/362] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:57 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:35:58.384131 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-19047b07-f751-4e5f-a334-17c1577cdcbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:58.393334 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-19047b07-f751-4e5f-a334-17c1577cdcbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:58.401892 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-19047b07-f751-4e5f-a334-17c1577cdcbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:58.402895 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-19047b07-f751-4e5f-a334-17c1577cdcbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:58.406277 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-19047b07-f751-4e5f-a334-17c1577cdcbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:58.406835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-19047b07-f751-4e5f-a334-17c1577cdcbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:58.810909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-19047b07-f751-4e5f-a334-17c1577cdcbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:58.814339 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b67b9a1b-9619-419b-ba04-8e7fce890482 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:58.814957 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b67b9a1b-9619-419b-ba04-8e7fce890482 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:58.831266 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b67b9a1b-9619-419b-ba04-8e7fce890482 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:58.831761 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b67b9a1b-9619-419b-ba04-8e7fce890482 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:58.835326 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-19047b07-f751-4e5f-a334-17c1577cdcbf tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.457292 Jul 07 15:35:58.848575 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 176/363] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:58 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:58.848795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b67b9a1b-9619-419b-ba04-8e7fce890482 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:58.851009 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b67b9a1b-9619-419b-ba04-8e7fce890482 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:58.862081 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-999261c1-0b50-40c8-8502-c9cf40d5fdb3 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:58.864385 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-999261c1-0b50-40c8-8502-c9cf40d5fdb3 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:58.880187 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-999261c1-0b50-40c8-8502-c9cf40d5fdb3 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:58.881382 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-999261c1-0b50-40c8-8502-c9cf40d5fdb3 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:58.882397 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-999261c1-0b50-40c8-8502-c9cf40d5fdb3 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:58.883028 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-999261c1-0b50-40c8-8502-c9cf40d5fdb3 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:59.060436 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-999261c1-0b50-40c8-8502-c9cf40d5fdb3 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:59.068713 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-999261c1-0b50-40c8-8502-c9cf40d5fdb3 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1266 microversion: 2.1 time: 0.228353 Jul 07 15:35:59.069228 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 177/364] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:58 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:59.093899 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:59.095325 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:59.102000 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:59.102798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:59.103744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:59.104278 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:59.254234 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b67b9a1b-9619-419b-ba04-8e7fce890482 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:59.316889 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b67b9a1b-9619-419b-ba04-8e7fce890482 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1697 microversion: 2.1 time: 0.513861 Jul 07 15:35:59.319424 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 188/365] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:58 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1697 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:35:59.332561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:59.351330 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ad7fa349-38ad-4f76-aa54-bdeca1e216fb tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:35:59.358687 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:59.362640 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:35:59.368240 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-db62bb0b-0d4f-408e-a04c-03840bf6c2eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1721 microversion: 2.20 time: 0.278751 Jul 07 15:35:59.370234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 178/366] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:35:59 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:35:59.376128 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad7fa349-38ad-4f76-aa54-bdeca1e216fb tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:59.376959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad7fa349-38ad-4f76-aa54-bdeca1e216fb tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:59.437178 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ad7fa349-38ad-4f76-aa54-bdeca1e216fb tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Going to try to start instance {{(pid=124719) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 07 15:35:59.743382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ad7fa349-38ad-4f76-aa54-bdeca1e216fb tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/action" status: 202 len: 0 microversion: 2.1 time: 0.404791 Jul 07 15:35:59.748956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 189/367] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:35:59 2022] POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:35:59.754658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ebab6c9b-26c8-4800-9982-37f8ddd8bef3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:59.756001 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ebab6c9b-26c8-4800-9982-37f8ddd8bef3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:59.766773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ebab6c9b-26c8-4800-9982-37f8ddd8bef3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:59.770852 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ebab6c9b-26c8-4800-9982-37f8ddd8bef3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:59.770852 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ebab6c9b-26c8-4800-9982-37f8ddd8bef3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:59.770852 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ebab6c9b-26c8-4800-9982-37f8ddd8bef3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:59.866711 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cf83b94c-449c-47d7-b7ff-402b05b528c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:35:59.867470 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cf83b94c-449c-47d7-b7ff-402b05b528c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:35:59.888699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf83b94c-449c-47d7-b7ff-402b05b528c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:59.892069 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf83b94c-449c-47d7-b7ff-402b05b528c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:35:59.896572 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf83b94c-449c-47d7-b7ff-402b05b528c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:35:59.897484 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf83b94c-449c-47d7-b7ff-402b05b528c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:00.066635 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ebab6c9b-26c8-4800-9982-37f8ddd8bef3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:00.078605 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ebab6c9b-26c8-4800-9982-37f8ddd8bef3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1706 microversion: 2.1 time: 0.329084 Jul 07 15:36:00.084448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 179/368] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:59 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1706 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:00.096453 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7f351c30-dd1a-43eb-aaab-228ef0b6fc23 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:00.097067 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7f351c30-dd1a-43eb-aaab-228ef0b6fc23 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:00.113526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7f351c30-dd1a-43eb-aaab-228ef0b6fc23 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:00.113972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7f351c30-dd1a-43eb-aaab-228ef0b6fc23 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:00.114736 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7f351c30-dd1a-43eb-aaab-228ef0b6fc23 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:00.115159 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7f351c30-dd1a-43eb-aaab-228ef0b6fc23 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:00.223974 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7f351c30-dd1a-43eb-aaab-228ef0b6fc23 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:00.232971 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7f351c30-dd1a-43eb-aaab-228ef0b6fc23 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1272 microversion: 2.1 time: 0.145521 Jul 07 15:36:00.234220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 180/369] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:00 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:00.238735 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cf83b94c-449c-47d7-b7ff-402b05b528c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:00.256189 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cf83b94c-449c-47d7-b7ff-402b05b528c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.402723 Jul 07 15:36:00.270235 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 190/370] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:35:59 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:00.397634 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:00.398247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:00.410557 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:00.414444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:00.414444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:00.414444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:00.652326 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:00.662400 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:00.664009 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:00.665375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-37cb9232-2ca3-4745-98ba-6c38c0431a55 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1721 microversion: 2.20 time: 0.271991 Jul 07 15:36:00.666115 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 181/371] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:00 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:01.101000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4741527d-bf46-4636-b92c-a94c608e7af9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:01.102365 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4741527d-bf46-4636-b92c-a94c608e7af9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:01.108915 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4741527d-bf46-4636-b92c-a94c608e7af9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:01.109589 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4741527d-bf46-4636-b92c-a94c608e7af9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:01.110566 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4741527d-bf46-4636-b92c-a94c608e7af9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:01.111142 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4741527d-bf46-4636-b92c-a94c608e7af9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:01.255318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a84c6e3c-694c-43a0-82c6-3036d5fdeb6d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:01.257269 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a84c6e3c-694c-43a0-82c6-3036d5fdeb6d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:01.272399 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a84c6e3c-694c-43a0-82c6-3036d5fdeb6d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:01.274652 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a84c6e3c-694c-43a0-82c6-3036d5fdeb6d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:01.275330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a84c6e3c-694c-43a0-82c6-3036d5fdeb6d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:01.275330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a84c6e3c-694c-43a0-82c6-3036d5fdeb6d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:01.323837 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4741527d-bf46-4636-b92c-a94c608e7af9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:01.333312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4741527d-bf46-4636-b92c-a94c608e7af9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1706 microversion: 2.1 time: 0.236238 Jul 07 15:36:01.343473 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 191/372] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:01 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1706 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:01.349931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-30577608-5f03-4630-8b42-5fc7458e0370 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:01.350769 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-30577608-5f03-4630-8b42-5fc7458e0370 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:01.361363 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30577608-5f03-4630-8b42-5fc7458e0370 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:01.361815 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30577608-5f03-4630-8b42-5fc7458e0370 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:01.362838 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30577608-5f03-4630-8b42-5fc7458e0370 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:01.363274 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30577608-5f03-4630-8b42-5fc7458e0370 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:01.402657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a84c6e3c-694c-43a0-82c6-3036d5fdeb6d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:01.414558 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a84c6e3c-694c-43a0-82c6-3036d5fdeb6d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1272 microversion: 2.1 time: 0.167044 Jul 07 15:36:01.424057 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 182/373] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:01 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:01.561696 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-30577608-5f03-4630-8b42-5fc7458e0370 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:01.571316 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-30577608-5f03-4630-8b42-5fc7458e0370 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.226301 Jul 07 15:36:01.583843 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 192/374] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:01 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:01.603731 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-226f7cba-5693-4648-a1e0-ff5b899731d4 req-f3002504-b84b-40c3-a8d3-a0e6f9ca02d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e85e6b3-ebad-441e-afcd-31692b27b782", "name": "network-vif-unplugged", "status": "completed", "tag": "8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:01.615519 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-226f7cba-5693-4648-a1e0-ff5b899731d4 req-f3002504-b84b-40c3-a8d3-a0e6f9ca02d1 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:01.616289 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-226f7cba-5693-4648-a1e0-ff5b899731d4 req-f3002504-b84b-40c3-a8d3-a0e6f9ca02d1 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:01.629534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-226f7cba-5693-4648-a1e0-ff5b899731d4 req-f3002504-b84b-40c3-a8d3-a0e6f9ca02d1 service nova] Creating event network-vif-unplugged:8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a for instance 2e85e6b3-ebad-441e-afcd-31692b27b782 on hv-cinder-84130 Jul 07 15:36:01.636651 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-226f7cba-5693-4648-a1e0-ff5b899731d4 req-f3002504-b84b-40c3-a8d3-a0e6f9ca02d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038394 Jul 07 15:36:01.637253 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 183/375] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:01.685432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:01.686042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:01.692858 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:01.693833 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:01.694610 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:01.695540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:01.865115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:01.875849 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:01.877601 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:01.878918 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ada70ba0-0c64-4e10-834a-a04c31ee6cd3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1721 microversion: 2.20 time: 0.198518 Jul 07 15:36:01.879484 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 193/376] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:01 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:02.354898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d0c317fe-8ebf-423d-85c2-ee8a5c7eb2c3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:02.357859 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d0c317fe-8ebf-423d-85c2-ee8a5c7eb2c3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:02.366990 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0c317fe-8ebf-423d-85c2-ee8a5c7eb2c3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:02.367939 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0c317fe-8ebf-423d-85c2-ee8a5c7eb2c3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:02.369500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0c317fe-8ebf-423d-85c2-ee8a5c7eb2c3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:02.370102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0c317fe-8ebf-423d-85c2-ee8a5c7eb2c3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:02.433638 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3f8cc606-2b49-41e4-b050-b98ca53f718f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:02.434867 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3f8cc606-2b49-41e4-b050-b98ca53f718f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:02.443941 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f8cc606-2b49-41e4-b050-b98ca53f718f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:02.452537 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f8cc606-2b49-41e4-b050-b98ca53f718f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:02.453826 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f8cc606-2b49-41e4-b050-b98ca53f718f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:02.454431 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f8cc606-2b49-41e4-b050-b98ca53f718f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:02.817707 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d0c317fe-8ebf-423d-85c2-ee8a5c7eb2c3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:02.837589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d0c317fe-8ebf-423d-85c2-ee8a5c7eb2c3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1706 microversion: 2.1 time: 0.488376 Jul 07 15:36:02.838276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 184/377] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:02 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1706 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:02.844472 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-958ba585-5609-4613-a46b-603bcd9b824c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:02.846595 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-958ba585-5609-4613-a46b-603bcd9b824c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:02.853068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:02.854937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-958ba585-5609-4613-a46b-603bcd9b824c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:02.855472 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-958ba585-5609-4613-a46b-603bcd9b824c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:02.863728 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-958ba585-5609-4613-a46b-603bcd9b824c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:02.863728 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-958ba585-5609-4613-a46b-603bcd9b824c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:03.169905 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3f8cc606-2b49-41e4-b050-b98ca53f718f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:03.180183 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3f8cc606-2b49-41e4-b050-b98ca53f718f tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1314 microversion: 2.1 time: 0.750425 Jul 07 15:36:03.181491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 194/378] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:02 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:03.191466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:03.193073 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:03.201150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:03.202035 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:03.203050 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:03.204232 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:03.566801 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-958ba585-5609-4613-a46b-603bcd9b824c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:03.581869 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-958ba585-5609-4613-a46b-603bcd9b824c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.742216 Jul 07 15:36:03.583105 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 185/379] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:02 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:03.588634 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-e8b8c8f1-5faa-4e98-b99f-005edc11f998 req-c6cc984d-2094-4b4c-a49e-f5f2e73a3e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbefda7a-a7a6-418c-a5a2-abaf6451ef7a", "tag": "52b419cf-1015-4084-93af-9e336d123a8d"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:03.602827 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-e8b8c8f1-5faa-4e98-b99f-005edc11f998 req-c6cc984d-2094-4b4c-a49e-f5f2e73a3e37 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:03.603749 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-e8b8c8f1-5faa-4e98-b99f-005edc11f998 req-c6cc984d-2094-4b4c-a49e-f5f2e73a3e37 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:03.605713 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:03.626284 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-e8b8c8f1-5faa-4e98-b99f-005edc11f998 req-c6cc984d-2094-4b4c-a49e-f5f2e73a3e37 service nova] Creating event network-changed:52b419cf-1015-4084-93af-9e336d123a8d for instance dbefda7a-a7a6-418c-a5a2-abaf6451ef7a on hv-cinder-84130 Jul 07 15:36:03.634188 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-e8b8c8f1-5faa-4e98-b99f-005edc11f998 req-c6cc984d-2094-4b4c-a49e-f5f2e73a3e37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047252 Jul 07 15:36:03.639519 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 186/380] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:03.642040 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:03.643907 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:03.645286 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a9023241-73fa-45ea-98c5-e7eff53b8902 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1724 microversion: 2.20 time: 0.462574 Jul 07 15:36:03.646016 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 195/381] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:03 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1724 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:03.670515 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8c56f953-56cb-44ac-b0b8-1f4ce23fd7a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df52655-d261-4b3d-9c99-4797df6a43e1"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:03.671770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8c56f953-56cb-44ac-b0b8-1f4ce23fd7a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:03.683794 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c56f953-56cb-44ac-b0b8-1f4ce23fd7a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:03.684250 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c56f953-56cb-44ac-b0b8-1f4ce23fd7a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:03.685042 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c56f953-56cb-44ac-b0b8-1f4ce23fd7a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:03.685478 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c56f953-56cb-44ac-b0b8-1f4ce23fd7a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:03.860013 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-28d64e07-f518-4731-b82d-93f5c44ea3ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:03.860810 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-28d64e07-f518-4731-b82d-93f5c44ea3ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:03.869821 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-28d64e07-f518-4731-b82d-93f5c44ea3ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:03.870531 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-28d64e07-f518-4731-b82d-93f5c44ea3ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:03.871547 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-28d64e07-f518-4731-b82d-93f5c44ea3ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:03.872231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-28d64e07-f518-4731-b82d-93f5c44ea3ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:04.117273 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-28d64e07-f518-4731-b82d-93f5c44ea3ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:04.126268 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-28d64e07-f518-4731-b82d-93f5c44ea3ec tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1706 microversion: 2.1 time: 0.271532 Jul 07 15:36:04.126845 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 196/382] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:03 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1706 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:04.198777 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ba8185b2-d946-47fb-91cf-d6fc7d2897c4 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:04.199419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ba8185b2-d946-47fb-91cf-d6fc7d2897c4 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:04.206500 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ba8185b2-d946-47fb-91cf-d6fc7d2897c4 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:04.206950 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ba8185b2-d946-47fb-91cf-d6fc7d2897c4 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:04.207772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ba8185b2-d946-47fb-91cf-d6fc7d2897c4 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:04.208206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ba8185b2-d946-47fb-91cf-d6fc7d2897c4 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:04.495136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ba8185b2-d946-47fb-91cf-d6fc7d2897c4 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:04.504820 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ba8185b2-d946-47fb-91cf-d6fc7d2897c4 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1314 microversion: 2.1 time: 0.310217 Jul 07 15:36:04.505686 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 197/383] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:04 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:04.600692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f9b02852-9e04-44bd-a5eb-6a0e3d88df31 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:04.601573 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f9b02852-9e04-44bd-a5eb-6a0e3d88df31 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:04.611277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f9b02852-9e04-44bd-a5eb-6a0e3d88df31 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:04.612555 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f9b02852-9e04-44bd-a5eb-6a0e3d88df31 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:04.613789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f9b02852-9e04-44bd-a5eb-6a0e3d88df31 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:04.614449 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f9b02852-9e04-44bd-a5eb-6a0e3d88df31 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:04.742669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8c56f953-56cb-44ac-b0b8-1f4ce23fd7a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.082230 Jul 07 15:36:04.743993 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 187/384] 10.222.0.25 () {62 vars in 1363 bytes} [Thu Jul 7 15:36:03 2022] POST /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 188 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:36:04.910590 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f9b02852-9e04-44bd-a5eb-6a0e3d88df31 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:04.930256 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f9b02852-9e04-44bd-a5eb-6a0e3d88df31 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.333892 Jul 07 15:36:04.940568 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 198/385] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:04 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:04.947972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-860b89ae-9383-4f4c-b071-86d8f7ff82a2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:04.948911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-860b89ae-9383-4f4c-b071-86d8f7ff82a2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:04.957808 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-860b89ae-9383-4f4c-b071-86d8f7ff82a2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:04.959174 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-860b89ae-9383-4f4c-b071-86d8f7ff82a2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:04.960259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-860b89ae-9383-4f4c-b071-86d8f7ff82a2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:04.961459 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-860b89ae-9383-4f4c-b071-86d8f7ff82a2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:05.144097 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-41f3277f-e4d7-4f46-9c5a-7276593fc292 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:05.144695 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-41f3277f-e4d7-4f46-9c5a-7276593fc292 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:05.150839 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-41f3277f-e4d7-4f46-9c5a-7276593fc292 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:05.151288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-41f3277f-e4d7-4f46-9c5a-7276593fc292 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:05.152225 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-41f3277f-e4d7-4f46-9c5a-7276593fc292 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:05.152653 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-41f3277f-e4d7-4f46-9c5a-7276593fc292 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:05.226016 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-860b89ae-9383-4f4c-b071-86d8f7ff82a2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/action" status: 202 len: 0 microversion: 2.20 time: 0.282949 Jul 07 15:36:05.226902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 188/386] 10.222.0.25 () {62 vars in 1318 bytes} [Thu Jul 7 15:36:04 2022] POST /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:36:05.234870 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:05.235737 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:05.242148 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:05.242647 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:05.243481 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:05.244012 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:05.349412 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-41f3277f-e4d7-4f46-9c5a-7276593fc292 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:05.371822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-41f3277f-e4d7-4f46-9c5a-7276593fc292 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1710 microversion: 2.1 time: 0.231977 Jul 07 15:36:05.374685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 199/387] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:05 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1710 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:05.526072 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-13bd206c-83ea-4987-be0f-202df6d36ced tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:05.529578 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-13bd206c-83ea-4987-be0f-202df6d36ced tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:05.538980 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13bd206c-83ea-4987-be0f-202df6d36ced tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:05.539820 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13bd206c-83ea-4987-be0f-202df6d36ced tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:05.541192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13bd206c-83ea-4987-be0f-202df6d36ced tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:05.541855 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-13bd206c-83ea-4987-be0f-202df6d36ced tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:05.544161 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:05.549021 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:05.555219 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:05.559181 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:05.560985 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1312ce11-7f15-40d7-8c34-b62a283b8bbd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1750 microversion: 2.20 time: 0.330066 Jul 07 15:36:05.563850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 189/388] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:05 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1750 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:05.947685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c1ab986c-7028-42cd-9cab-fe5c005ee234 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:05.948519 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c1ab986c-7028-42cd-9cab-fe5c005ee234 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:05.964308 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1ab986c-7028-42cd-9cab-fe5c005ee234 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:05.965165 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1ab986c-7028-42cd-9cab-fe5c005ee234 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:05.966815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1ab986c-7028-42cd-9cab-fe5c005ee234 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:05.967480 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1ab986c-7028-42cd-9cab-fe5c005ee234 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:05.991470 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:06.032685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:06.106364 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-13bd206c-83ea-4987-be0f-202df6d36ced tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:06.119873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-13bd206c-83ea-4987-be0f-202df6d36ced tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1314 microversion: 2.1 time: 0.599685 Jul 07 15:36:06.122406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 200/389] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:05 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:06.247204 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c1ab986c-7028-42cd-9cab-fe5c005ee234 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:06.258824 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c1ab986c-7028-42cd-9cab-fe5c005ee234 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.315026 Jul 07 15:36:06.260153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 190/390] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:05 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:06.583239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:06.584153 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:06.590808 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:06.591542 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:06.592808 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:06.593477 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:06.761525 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:06.771666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:06.773398 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:06.775045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2168fc8e-04ad-476f-ba0d-48428d111369 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1750 microversion: 2.20 time: 0.197567 Jul 07 15:36:06.775701 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 201/391] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:06 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:07.140038 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c70936da-29ba-4498-a9db-cb528fb0e116 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:07.144638 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c70936da-29ba-4498-a9db-cb528fb0e116 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:07.149013 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c70936da-29ba-4498-a9db-cb528fb0e116 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:07.149451 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c70936da-29ba-4498-a9db-cb528fb0e116 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:07.150242 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c70936da-29ba-4498-a9db-cb528fb0e116 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:07.150676 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c70936da-29ba-4498-a9db-cb528fb0e116 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:07.276706 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-68a4e854-e9b6-414d-b185-fbce521073f1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:07.282653 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-68a4e854-e9b6-414d-b185-fbce521073f1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:07.284987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=96 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:07.290641 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-68a4e854-e9b6-414d-b185-fbce521073f1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:07.291280 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-68a4e854-e9b6-414d-b185-fbce521073f1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:07.292256 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-68a4e854-e9b6-414d-b185-fbce521073f1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:07.293141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-68a4e854-e9b6-414d-b185-fbce521073f1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:07.430192 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c70936da-29ba-4498-a9db-cb528fb0e116 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:07.445472 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c70936da-29ba-4498-a9db-cb528fb0e116 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1314 microversion: 2.1 time: 0.308438 Jul 07 15:36:07.449945 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 191/392] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:07 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:07.497528 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-68a4e854-e9b6-414d-b185-fbce521073f1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:07.505099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-68a4e854-e9b6-414d-b185-fbce521073f1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.232509 Jul 07 15:36:07.505698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 202/393] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:07 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:07.794003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:07.794616 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:07.818648 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=10 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:07.829551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:07.830146 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:07.832450 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:07.832977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:08.082998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:08.092161 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:08.095199 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:08.096450 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0684fe54-ba24-45cd-be92-07fea93503ca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1752 microversion: 2.20 time: 0.306500 Jul 07 15:36:08.097018 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 192/394] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:07 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1752 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:08.468922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bd310d91-ac7e-4bfd-b55d-610c9c453bb8 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:08.469550 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bd310d91-ac7e-4bfd-b55d-610c9c453bb8 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:08.482592 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bd310d91-ac7e-4bfd-b55d-610c9c453bb8 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:08.483419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bd310d91-ac7e-4bfd-b55d-610c9c453bb8 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:08.485346 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bd310d91-ac7e-4bfd-b55d-610c9c453bb8 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:08.485985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bd310d91-ac7e-4bfd-b55d-610c9c453bb8 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:08.525524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f6c24640-bfb6-4873-bcbc-04247db3dc9b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:08.526449 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f6c24640-bfb6-4873-bcbc-04247db3dc9b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:08.539895 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f6c24640-bfb6-4873-bcbc-04247db3dc9b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:08.542921 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f6c24640-bfb6-4873-bcbc-04247db3dc9b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:08.544074 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f6c24640-bfb6-4873-bcbc-04247db3dc9b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:08.545833 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f6c24640-bfb6-4873-bcbc-04247db3dc9b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:08.814341 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bd310d91-ac7e-4bfd-b55d-610c9c453bb8 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:08.817934 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f6c24640-bfb6-4873-bcbc-04247db3dc9b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:08.823458 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bd310d91-ac7e-4bfd-b55d-610c9c453bb8 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1314 microversion: 2.1 time: 0.360932 Jul 07 15:36:08.824233 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 203/395] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:08 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:08.831011 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f6c24640-bfb6-4873-bcbc-04247db3dc9b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1501 microversion: 2.1 time: 0.312166 Jul 07 15:36:08.836149 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 193/396] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:08 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:08.848700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "690bbbb8-a9bb-4f83-977b-0bd229445a8f"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:08.850000 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:08.856566 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:08.857069 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:08.857794 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:08.858441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:08.882104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] HTTP exception thrown: Cannot 'attach_volume' instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 while it is in vm_state rescued Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Request method failure captured: Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: POST /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69/os-volume_attachments HTTP/1.1 Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 74 Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv0JGRXksEBbg0w67HlozL4VW71_ag0hzYbFjCOPe6-Dn4Q6sXAn89l0RxBVWxsLjAvIZwxa2fxfqxK4Ew1N4hRqwmjkN9YjOWMCW1veSaiKYUxr1SaVGN6D8bsYtVz94rH8MgMnXHNMOQ3twr-mW9qa-5kmlnf94Q0d0eQvaqgapjM Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:36:08.884037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8404651e9fb4443a9cdebb3f79a4e6a8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 9528a9a3306d49b0978d77d1ce1ca900 Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {"volumeAttachment": {"volumeId": "690bbbb8-a9bb-4f83-977b-0bd229445a8f"}} Jul 07 15:36:08.885571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Cannot 'attach_volume' instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 while it is in vm_state rescued Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'server_id': '73c2472d-0015-49d1-ab4c-7eb597cbaa69', 'body': {'volumeAttachment': {'volumeId': '690bbbb8-a9bb-4f83-977b-0bd229445a8f'}}} Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:36:08.886428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 while it is in vm_state rescued Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:08.887850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:08.889087 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:36:08.889087 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:36:08.889087 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 while it is in vm_state rescued Jul 07 15:36:08.889087 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:08.889087 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Returning 409 to user: Cannot 'attach_volume' instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 while it is in vm_state rescued {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:36:08.889087 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d584a038-b2f3-4202-b337-57b54b85aa92 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041986 Jul 07 15:36:08.889523 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 194/397] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:36:08 2022] POST /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 07 15:36:08.894467 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-293bf285-69fa-48d4-a1d3-07227007dfed tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:08.894990 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-293bf285-69fa-48d4-a1d3-07227007dfed tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:08.900868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-293bf285-69fa-48d4-a1d3-07227007dfed tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:08.901311 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-293bf285-69fa-48d4-a1d3-07227007dfed tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:08.902068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-293bf285-69fa-48d4-a1d3-07227007dfed tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:08.902499 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-293bf285-69fa-48d4-a1d3-07227007dfed tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:08.939746 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c3b2d3ed-df48-4f58-8a2f-45dde1857784 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Action: 'create', calling method: .version_select at 0x7f524976cc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-888789777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFnz0mhkQuwgfiRpPPsdXUMPXls77fWth+Ao2pPyJo/Em5ZpdCulwqDWsn6u/nHPpnqf8EcvkEu8eyccAdl4IId/3Vtra8w8wQU+nd7ZDP7xJGou8hUhgfa6nNdgloUGA=="}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:08.975656 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-c3b2d3ed-df48-4f58-8a2f-45dde1857784 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Getting quotas for project 41be827d61314cdbb5387c24e6353bb5. Resources: {'key_pairs'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:36:08.980563 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-c3b2d3ed-df48-4f58-8a2f-45dde1857784 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Getting quotas for user 4a7231c86e1a4c4bb851f317a935079d and project 41be827d61314cdbb5387c24e6353bb5. Resources: {'key_pairs'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:36:09.116189 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c3b2d3ed-df48-4f58-8a2f-45dde1857784 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.290531 Jul 07 15:36:09.116706 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 204/398] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:36:08 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:09.121327 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:09.121990 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:09.129118 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:09.129749 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:09.130510 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:09.131062 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:09.147371 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-293bf285-69fa-48d4-a1d3-07227007dfed tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69/action" status: 202 len: 0 microversion: 2.1 time: 0.256818 Jul 07 15:36:09.151340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 195/399] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:36:08 2022] POST /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:36:09.156803 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2a40bb4e-e6d9-4741-989d-5dbe3634a8c8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:09.157490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2a40bb4e-e6d9-4741-989d-5dbe3634a8c8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:09.164237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2a40bb4e-e6d9-4741-989d-5dbe3634a8c8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:09.164672 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2a40bb4e-e6d9-4741-989d-5dbe3634a8c8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:09.165611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2a40bb4e-e6d9-4741-989d-5dbe3634a8c8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:09.166039 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2a40bb4e-e6d9-4741-989d-5dbe3634a8c8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:09.435938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:09.447170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:09.448809 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:09.450034 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6d9db1be-59dc-4d4d-b9df-95c00e8353ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1752 microversion: 2.20 time: 0.332366 Jul 07 15:36:09.450658 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 205/400] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:09 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1752 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:09.479057 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2a40bb4e-e6d9-4741-989d-5dbe3634a8c8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:09.491979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2a40bb4e-e6d9-4741-989d-5dbe3634a8c8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1509 microversion: 2.1 time: 0.339346 Jul 07 15:36:09.494347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 196/401] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:09 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:09.761085 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-0392da73-1d57-458e-b5bf-516771e1202f req-8e98648e-26b0-4f31-8707-8d4e6e4961fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbefda7a-a7a6-418c-a5a2-abaf6451ef7a", "name": "network-vif-plugged", "status": "completed", "tag": "52b419cf-1015-4084-93af-9e336d123a8d"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:09.776322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-0392da73-1d57-458e-b5bf-516771e1202f req-8e98648e-26b0-4f31-8707-8d4e6e4961fb service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:09.779736 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-0392da73-1d57-458e-b5bf-516771e1202f req-8e98648e-26b0-4f31-8707-8d4e6e4961fb service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:09.803587 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-0392da73-1d57-458e-b5bf-516771e1202f req-8e98648e-26b0-4f31-8707-8d4e6e4961fb service nova] Creating event network-vif-plugged:52b419cf-1015-4084-93af-9e336d123a8d for instance dbefda7a-a7a6-418c-a5a2-abaf6451ef7a on hv-cinder-84130 Jul 07 15:36:09.809099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-0392da73-1d57-458e-b5bf-516771e1202f req-8e98648e-26b0-4f31-8707-8d4e6e4961fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052104 Jul 07 15:36:09.811286 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 206/402] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:36:09.841601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c1207a3c-c967-48cc-921e-e2e862f702b1 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:09.843086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c1207a3c-c967-48cc-921e-e2e862f702b1 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:09.858376 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1207a3c-c967-48cc-921e-e2e862f702b1 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:09.860873 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1207a3c-c967-48cc-921e-e2e862f702b1 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:09.862409 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1207a3c-c967-48cc-921e-e2e862f702b1 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:09.863382 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1207a3c-c967-48cc-921e-e2e862f702b1 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:10.091347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c1207a3c-c967-48cc-921e-e2e862f702b1 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:10.101973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c1207a3c-c967-48cc-921e-e2e862f702b1 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1314 microversion: 2.1 time: 0.264386 Jul 07 15:36:10.102861 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 197/403] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:09 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:10.481049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:10.481987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:10.490569 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:10.491361 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:10.492480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:10.493100 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:10.514414 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b246b8aa-ab41-446d-b682-90c213e3898b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:10.515085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b246b8aa-ab41-446d-b682-90c213e3898b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:10.522897 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b246b8aa-ab41-446d-b682-90c213e3898b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:10.523421 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b246b8aa-ab41-446d-b682-90c213e3898b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:10.525082 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b246b8aa-ab41-446d-b682-90c213e3898b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:10.525530 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b246b8aa-ab41-446d-b682-90c213e3898b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:10.730030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:10.742126 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b246b8aa-ab41-446d-b682-90c213e3898b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:10.742251 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:10.742251 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:10.743396 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9d906dc1-284d-4632-bab2-bbf87e13bc92 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.269707 Jul 07 15:36:10.754364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b246b8aa-ab41-446d-b682-90c213e3898b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1509 microversion: 2.1 time: 0.241383 Jul 07 15:36:10.755459 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 198/404] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:10 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:10.755871 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 207/405] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:10 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:11.119102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6b8839d7-f9d2-4c7b-b33b-12a9f29d1d65 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:11.119789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6b8839d7-f9d2-4c7b-b33b-12a9f29d1d65 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:11.126471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6b8839d7-f9d2-4c7b-b33b-12a9f29d1d65 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:11.126934 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6b8839d7-f9d2-4c7b-b33b-12a9f29d1d65 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:11.127720 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6b8839d7-f9d2-4c7b-b33b-12a9f29d1d65 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:11.128151 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6b8839d7-f9d2-4c7b-b33b-12a9f29d1d65 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:11.314954 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6b8839d7-f9d2-4c7b-b33b-12a9f29d1d65 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:11.325177 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6b8839d7-f9d2-4c7b-b33b-12a9f29d1d65 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1314 microversion: 2.1 time: 0.209858 Jul 07 15:36:11.325776 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 199/406] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:11 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:11.766302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6ce0475d-f6f9-43d8-93fc-617bd09e450c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:11.768461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:11.769576 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6ce0475d-f6f9-43d8-93fc-617bd09e450c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:11.770370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:11.781302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ce0475d-f6f9-43d8-93fc-617bd09e450c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:11.781302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ce0475d-f6f9-43d8-93fc-617bd09e450c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:11.784952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:11.786233 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:11.786699 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ce0475d-f6f9-43d8-93fc-617bd09e450c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:11.788385 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:11.788712 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ce0475d-f6f9-43d8-93fc-617bd09e450c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:11.789893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:12.131223 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6ce0475d-f6f9-43d8-93fc-617bd09e450c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:12.136407 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:12.146702 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6ce0475d-f6f9-43d8-93fc-617bd09e450c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1509 microversion: 2.1 time: 0.383789 Jul 07 15:36:12.147806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:12.149919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:12.151126 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e1cdad49-313a-4865-bee3-15194559002c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.392820 Jul 07 15:36:12.151693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 208/407] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:11 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:12.168748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 200/408] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:11 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:12.342707 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-32b68466-2f0c-4a43-9511-1dbeedf3d1ba tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:12.343939 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-32b68466-2f0c-4a43-9511-1dbeedf3d1ba tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:12.350057 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-32b68466-2f0c-4a43-9511-1dbeedf3d1ba tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:12.350500 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-32b68466-2f0c-4a43-9511-1dbeedf3d1ba tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:12.351369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-32b68466-2f0c-4a43-9511-1dbeedf3d1ba tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:12.351830 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-32b68466-2f0c-4a43-9511-1dbeedf3d1ba tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:12.503216 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-32b68466-2f0c-4a43-9511-1dbeedf3d1ba tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:12.510717 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-32b68466-2f0c-4a43-9511-1dbeedf3d1ba tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1314 microversion: 2.1 time: 0.171930 Jul 07 15:36:12.511281 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 209/409] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:12 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:13.167325 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3ec4fd43-5e70-42d0-aee7-866635959288 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:13.167969 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3ec4fd43-5e70-42d0-aee7-866635959288 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:13.174583 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ec4fd43-5e70-42d0-aee7-866635959288 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:13.175007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ec4fd43-5e70-42d0-aee7-866635959288 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:13.175873 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ec4fd43-5e70-42d0-aee7-866635959288 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:13.176312 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3ec4fd43-5e70-42d0-aee7-866635959288 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:13.177245 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:13.177854 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:13.183916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:13.184375 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:13.185140 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:13.185577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:13.375975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3ec4fd43-5e70-42d0-aee7-866635959288 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:13.380121 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:13.383759 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3ec4fd43-5e70-42d0-aee7-866635959288 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1515 microversion: 2.1 time: 0.220245 Jul 07 15:36:13.386643 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 201/410] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:13 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:13.391976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:13.398985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:13.398985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f7d60237-c659-4eee-9978-e7488bafd28b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.223485 Jul 07 15:36:13.401515 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 210/411] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:13 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:13.528247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-925b23de-677b-4fc9-ac1c-91922dcc0235 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:13.528840 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-925b23de-677b-4fc9-ac1c-91922dcc0235 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:13.534847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-925b23de-677b-4fc9-ac1c-91922dcc0235 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:13.535297 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-925b23de-677b-4fc9-ac1c-91922dcc0235 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:13.536095 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-925b23de-677b-4fc9-ac1c-91922dcc0235 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:13.536527 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-925b23de-677b-4fc9-ac1c-91922dcc0235 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:13.673181 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-925b23de-677b-4fc9-ac1c-91922dcc0235 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:13.680804 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-925b23de-677b-4fc9-ac1c-91922dcc0235 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1314 microversion: 2.1 time: 0.156419 Jul 07 15:36:13.681366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 202/412] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:13 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:14.415616 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:14.416228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:14.422427 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:14.422881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:14.423700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:14.424110 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:14.571593 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:14.582556 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:14.584197 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:14.585669 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5a521115-8fe0-41a4-a0b6-47b85c500041 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.174054 Jul 07 15:36:14.586477 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 211/413] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:14 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:14.700691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-bee6df87-05b8-464b-bca2-28e54c933f25 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:14.701469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-bee6df87-05b8-464b-bca2-28e54c933f25 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:14.708680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bee6df87-05b8-464b-bca2-28e54c933f25 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:14.709126 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bee6df87-05b8-464b-bca2-28e54c933f25 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:14.709884 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bee6df87-05b8-464b-bca2-28e54c933f25 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:14.710824 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bee6df87-05b8-464b-bca2-28e54c933f25 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:14.850791 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-bee6df87-05b8-464b-bca2-28e54c933f25 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:14.858908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-bee6df87-05b8-464b-bca2-28e54c933f25 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1464 microversion: 2.1 time: 0.162215 Jul 07 15:36:14.859473 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 203/414] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:14 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:14.907550 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6f16c4f0-41b8-47de-a06d-830ed910edcb tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:14.908126 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6f16c4f0-41b8-47de-a06d-830ed910edcb tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:14.914176 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6f16c4f0-41b8-47de-a06d-830ed910edcb tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:14.914623 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6f16c4f0-41b8-47de-a06d-830ed910edcb tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:14.915376 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6f16c4f0-41b8-47de-a06d-830ed910edcb tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:14.915821 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6f16c4f0-41b8-47de-a06d-830ed910edcb tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:14.943352 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6f16c4f0-41b8-47de-a06d-830ed910edcb tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:36:14.970336 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-82dfc183-c58a-4a36-a1d9-ac620fe8ab7f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'create', calling method: .version_select at 0x7f5248ff5940>, body: {"keypair": {"name": "tempest-keypair-1187242409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApZL8OpvgKtPTIo8M9CDRNHAoTmMwLNpWRqywaCgPH8ELWStVCFi8FwpYbx9yQSFrz5t/kBPQaS2f0m2NvSZyyf1fmQ5sbhFRZiQlyclKwGbdy/tuew2Dr7ZIBNO98VAg=="}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:14.987377 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-82dfc183-c58a-4a36-a1d9-ac620fe8ab7f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Getting quotas for project 8404651e9fb4443a9cdebb3f79a4e6a8. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:36:14.994109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-82dfc183-c58a-4a36-a1d9-ac620fe8ab7f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Getting quotas for user 9528a9a3306d49b0978d77d1ce1ca900 and project 8404651e9fb4443a9cdebb3f79a4e6a8. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:36:15.028975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82dfc183-c58a-4a36-a1d9-ac620fe8ab7f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [b8bc2b8a-57e2-4a89-860a-ce57366233d5] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 07 15:36:15.302230 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6f16c4f0-41b8-47de-a06d-830ed910edcb tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 204 len: 0 microversion: 2.1 time: 0.398355 Jul 07 15:36:15.303698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 212/415] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:36:14 2022] DELETE /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:36:15.313173 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d0d3dc8e-5f56-4b29-b6c4-149e444dd2e6 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:15.314069 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d0d3dc8e-5f56-4b29-b6c4-149e444dd2e6 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:15.321705 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0d3dc8e-5f56-4b29-b6c4-149e444dd2e6 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:15.322147 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0d3dc8e-5f56-4b29-b6c4-149e444dd2e6 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:15.323234 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0d3dc8e-5f56-4b29-b6c4-149e444dd2e6 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:15.323851 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0d3dc8e-5f56-4b29-b6c4-149e444dd2e6 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:15.503843 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d0d3dc8e-5f56-4b29-b6c4-149e444dd2e6 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:15.513162 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d0d3dc8e-5f56-4b29-b6c4-149e444dd2e6 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.204629 Jul 07 15:36:15.524321 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 213/416] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:15 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:15.605395 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:15.605999 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:15.613366 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:15.614088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:15.615085 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:15.615802 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:15.770867 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:15.779238 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:15.780783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:15.781919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-63224c4b-15af-466f-bd3b-6fb72b87e824 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.180973 Jul 07 15:36:15.782466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 214/417] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:15 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:16.036345 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO oslo.messaging._drivers.impl_rabbit [None req-82dfc183-c58a-4a36-a1d9-ac620fe8ab7f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [b8bc2b8a-57e2-4a89-860a-ce57366233d5] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57292. Jul 07 15:36:16.121148 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-82dfc183-c58a-4a36-a1d9-ac620fe8ab7f tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.154612 Jul 07 15:36:16.121825 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 204/418] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:36:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:36:16.530932 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-71c1d4f2-148b-4980-b939-518036edc073 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:16.531546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-71c1d4f2-148b-4980-b939-518036edc073 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:16.538205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-71c1d4f2-148b-4980-b939-518036edc073 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:16.538654 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-71c1d4f2-148b-4980-b939-518036edc073 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:16.539408 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-71c1d4f2-148b-4980-b939-518036edc073 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:16.539870 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-71c1d4f2-148b-4980-b939-518036edc073 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:16.707327 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-71c1d4f2-148b-4980-b939-518036edc073 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:16.714796 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-71c1d4f2-148b-4980-b939-518036edc073 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.187948 Jul 07 15:36:16.715380 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 215/419] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:16 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:16.806281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:16.807117 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:16.818997 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:16.819912 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:16.820929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:16.821597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:16.976005 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:16.986527 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:16.988187 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:16.989471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-da8f3b65-6f1b-4491-94cb-7a11c56885b0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.187908 Jul 07 15:36:16.991061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 205/420] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:16 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:17.732938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-191d982e-bbcb-4d3a-8d7f-a4b35eccc472 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:17.733664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-191d982e-bbcb-4d3a-8d7f-a4b35eccc472 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:17.740015 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-191d982e-bbcb-4d3a-8d7f-a4b35eccc472 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:17.740571 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-191d982e-bbcb-4d3a-8d7f-a4b35eccc472 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:17.741202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-191d982e-bbcb-4d3a-8d7f-a4b35eccc472 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:17.741624 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-191d982e-bbcb-4d3a-8d7f-a4b35eccc472 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:17.904906 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-191d982e-bbcb-4d3a-8d7f-a4b35eccc472 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:17.908342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:17.915008 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-191d982e-bbcb-4d3a-8d7f-a4b35eccc472 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.186112 Jul 07 15:36:17.915656 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 216/421] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:17 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:18.008557 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:18.009171 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:18.016066 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:18.016972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:18.017964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:18.018597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:18.215056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:18.225054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:18.236370 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:18.243667 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-de006c44-c680-4b4f-a3fd-f4f291d9b3ac tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.239019 Jul 07 15:36:18.244606 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 206/422] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:18 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:18.938561 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5b2cbe36-9409-480c-9611-da1811007900 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:18.939267 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5b2cbe36-9409-480c-9611-da1811007900 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:18.946077 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5b2cbe36-9409-480c-9611-da1811007900 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:18.946607 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5b2cbe36-9409-480c-9611-da1811007900 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:18.947460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5b2cbe36-9409-480c-9611-da1811007900 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:18.947986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5b2cbe36-9409-480c-9611-da1811007900 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:18.990134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=4 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:19.109255 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5b2cbe36-9409-480c-9611-da1811007900 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:19.117799 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5b2cbe36-9409-480c-9611-da1811007900 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.183262 Jul 07 15:36:19.118617 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 217/423] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:18 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:19.262534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:19.263104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:19.269628 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:19.270081 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:19.270846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:19.271277 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:19.275315 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:19.480396 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:19.495293 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:19.496890 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:19.498059 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f2e5dc1b-a1ea-4e2c-8f85-4f329b8e8920 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.239605 Jul 07 15:36:19.498943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 207/424] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:19 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:19.593088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-554126239", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4a3d0bd-27a0-4957-a668-c94979f88543"}], "security_groups": [{"name": "tempest-securitygroup--1337540441"}], "key_name": "tempest-keypair-1187242409", "user_data": "}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:20.135660 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4dc4edfd-f7f2-4e51-ac68-9c246abe92b7 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:20.136197 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4dc4edfd-f7f2-4e51-ac68-9c246abe92b7 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:20.143073 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4dc4edfd-f7f2-4e51-ac68-9c246abe92b7 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:20.143585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4dc4edfd-f7f2-4e51-ac68-9c246abe92b7 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:20.154647 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4dc4edfd-f7f2-4e51-ac68-9c246abe92b7 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:20.154647 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4dc4edfd-f7f2-4e51-ac68-9c246abe92b7 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:20.288260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-4dc4edfd-f7f2-4e51-ac68-9c246abe92b7 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:20.295758 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4dc4edfd-f7f2-4e51-ac68-9c246abe92b7 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.164368 Jul 07 15:36:20.296325 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 208/425] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:20 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:20.538856 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:20.540536 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:20.546915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:20.547361 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:20.548772 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:20.549199 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:20.706692 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:20.715299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:20.716879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:20.718032 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8c003e8e-7b05-4912-ae91-200954e16a4d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.191685 Jul 07 15:36:20.718591 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 209/426] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:20 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:21.313573 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9f79d982-b027-4f59-a5f4-05154833eb70 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:21.315052 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9f79d982-b027-4f59-a5f4-05154833eb70 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:21.322294 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f79d982-b027-4f59-a5f4-05154833eb70 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:21.322834 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f79d982-b027-4f59-a5f4-05154833eb70 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:21.323721 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f79d982-b027-4f59-a5f4-05154833eb70 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:21.324240 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f79d982-b027-4f59-a5f4-05154833eb70 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:21.470700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9f79d982-b027-4f59-a5f4-05154833eb70 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:21.474561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9f79d982-b027-4f59-a5f4-05154833eb70 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.165463 Jul 07 15:36:21.475259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 210/427] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:21 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:21.737008 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:21.737616 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:21.743813 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:21.744208 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:21.744973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:21.745408 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:21.895957 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:21.904644 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:21.906366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:21.908178 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fb210a89-766f-4b2f-9997-1052ae410cfe tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.175130 Jul 07 15:36:21.908747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 211/428] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:21 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:22.496565 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-06731352-cf98-4a0d-a2af-a94561104e4e tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:22.507201 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-06731352-cf98-4a0d-a2af-a94561104e4e tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:22.507201 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-06731352-cf98-4a0d-a2af-a94561104e4e tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:22.507201 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-06731352-cf98-4a0d-a2af-a94561104e4e tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:22.507201 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-06731352-cf98-4a0d-a2af-a94561104e4e tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:22.507685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-06731352-cf98-4a0d-a2af-a94561104e4e tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:22.642251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-06731352-cf98-4a0d-a2af-a94561104e4e tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:22.650534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-06731352-cf98-4a0d-a2af-a94561104e4e tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.158078 Jul 07 15:36:22.651390 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 212/429] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:22 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:22.926855 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:22.927456 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:22.933817 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:22.934254 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:22.935062 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:22.935585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:23.091409 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:23.100033 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:23.101593 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:23.102753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8f9a35b2-37b6-4ccb-a096-8e6901f19f44 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.179977 Jul 07 15:36:23.103325 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 213/430] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:22 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:23.670775 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-39f514c5-dcfb-4761-8db1-20df480803f0 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:23.671502 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-39f514c5-dcfb-4761-8db1-20df480803f0 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:23.679121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-39f514c5-dcfb-4761-8db1-20df480803f0 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:23.679595 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-39f514c5-dcfb-4761-8db1-20df480803f0 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:23.680376 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-39f514c5-dcfb-4761-8db1-20df480803f0 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:23.680817 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-39f514c5-dcfb-4761-8db1-20df480803f0 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:23.828663 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-39f514c5-dcfb-4761-8db1-20df480803f0 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:23.837424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-39f514c5-dcfb-4761-8db1-20df480803f0 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.170928 Jul 07 15:36:23.837981 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 214/431] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:23 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:24.122840 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:24.123443 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:24.134516 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:24.134961 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:24.135776 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:24.136213 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:24.307024 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:24.316176 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:24.317773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:24.318938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-52692e18-13ea-496c-a433-092a2bd101af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.200644 Jul 07 15:36:24.319493 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 215/432] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:24 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:24.854234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9685ef29-3dfc-4838-956e-5ae64ae83a94 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:24.855515 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9685ef29-3dfc-4838-956e-5ae64ae83a94 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:24.866105 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9685ef29-3dfc-4838-956e-5ae64ae83a94 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:24.866584 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9685ef29-3dfc-4838-956e-5ae64ae83a94 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:24.867335 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9685ef29-3dfc-4838-956e-5ae64ae83a94 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:24.868223 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9685ef29-3dfc-4838-956e-5ae64ae83a94 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:24.874213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.network.neutron [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] validate_networks() for [('b4a3d0bd-27a0-4957-a668-c94979f88543', None, None, None, None, None)] {{(pid=124719) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:36:25.015650 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=4 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:25.088343 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9685ef29-3dfc-4838-956e-5ae64ae83a94 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:25.095940 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9685ef29-3dfc-4838-956e-5ae64ae83a94 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.245426 Jul 07 15:36:25.096518 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 216/433] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:24 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:25.337379 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:25.338412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:25.359092 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:25.359540 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:25.360358 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:25.360788 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:25.370358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Flavor limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:36:25.370786 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Image limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:36:25.371242 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Flavor pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:36:25.371662 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Image pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:36:25.372065 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:36:25.381859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:25.386443 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:25.386443 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:25.386443 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:25.433991 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Getting quotas for project 8404651e9fb4443a9cdebb3f79a4e6a8. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:36:25.440618 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Getting quotas for user 9528a9a3306d49b0978d77d1ce1ca900 and project 8404651e9fb4443a9cdebb3f79a4e6a8. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:36:25.485354 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Going to run 1 instances... {{(pid=124719) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:36:25.487753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:36:25.541762 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:25.566475 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:25.568429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:25.569652 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f7ec54e6-a88d-49ab-9210-cd35502bd7fb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.236443 Jul 07 15:36:25.573915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 217/434] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:25 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:25.654710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [efdafdfe-025b-41e1-a619-806ec144d451] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 07 15:36:26.113296 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d32420e8-38b8-4659-92bf-e0910eb98625 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:26.113908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d32420e8-38b8-4659-92bf-e0910eb98625 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:26.120434 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d32420e8-38b8-4659-92bf-e0910eb98625 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:26.120871 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d32420e8-38b8-4659-92bf-e0910eb98625 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:26.121622 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d32420e8-38b8-4659-92bf-e0910eb98625 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:26.122053 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d32420e8-38b8-4659-92bf-e0910eb98625 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:26.268435 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d32420e8-38b8-4659-92bf-e0910eb98625 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:26.276085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d32420e8-38b8-4659-92bf-e0910eb98625 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.166688 Jul 07 15:36:26.276660 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 218/435] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:26 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:26.592347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:26.592943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:26.599383 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:26.599852 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:26.600604 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:26.601025 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:26.662243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO oslo.messaging._drivers.impl_rabbit [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [efdafdfe-025b-41e1-a619-806ec144d451] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57392. Jul 07 15:36:26.666475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8285b8cd-b74d-4561-9b4f-fcd13bffac87 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 7.079248 Jul 07 15:36:26.667050 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 218/436] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:36:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 7081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:36:26.679627 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-96e48b2d-2a12-457a-8634-0ede632100de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:26.680783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-96e48b2d-2a12-457a-8634-0ede632100de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:26.745265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-96e48b2d-2a12-457a-8634-0ede632100de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:26.752026 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-96e48b2d-2a12-457a-8634-0ede632100de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1245 microversion: 2.1 time: 0.078338 Jul 07 15:36:26.760086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 219/437] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:26 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:26.773133 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:26.782125 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:26.784293 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:26.785482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1ed5cb44-cbab-43e6-9259-43e09c004f58 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.197035 Jul 07 15:36:26.786330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 219/438] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:26 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:27.294185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a66fbf51-51c5-4b2c-b872-4693fc6a082d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:27.294784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a66fbf51-51c5-4b2c-b872-4693fc6a082d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:27.300839 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a66fbf51-51c5-4b2c-b872-4693fc6a082d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:27.301274 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a66fbf51-51c5-4b2c-b872-4693fc6a082d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:27.302019 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a66fbf51-51c5-4b2c-b872-4693fc6a082d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:27.302440 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a66fbf51-51c5-4b2c-b872-4693fc6a082d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:27.648283 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a66fbf51-51c5-4b2c-b872-4693fc6a082d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:27.655745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a66fbf51-51c5-4b2c-b872-4693fc6a082d tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.365379 Jul 07 15:36:27.656308 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 220/439] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:27 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:27.768570 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7cba2231-57e7-44b1-8065-60fd97e41f94 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:27.769170 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7cba2231-57e7-44b1-8065-60fd97e41f94 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:27.775975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7cba2231-57e7-44b1-8065-60fd97e41f94 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:27.776426 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7cba2231-57e7-44b1-8065-60fd97e41f94 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:27.777194 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7cba2231-57e7-44b1-8065-60fd97e41f94 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:27.777624 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7cba2231-57e7-44b1-8065-60fd97e41f94 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:27.805218 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:27.805744 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:27.811808 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:27.812255 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:27.813027 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:27.813459 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:27.839924 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7cba2231-57e7-44b1-8065-60fd97e41f94 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:27.848178 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7cba2231-57e7-44b1-8065-60fd97e41f94 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1249 microversion: 2.1 time: 0.083384 Jul 07 15:36:27.848741 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 220/440] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:27 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:27.954328 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:27.963013 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:27.964519 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:27.965657 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-53dad1ba-6972-47a1-9572-856bd1a509d8 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.165447 Jul 07 15:36:27.966209 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 221/441] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:27 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:28.673169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-bd2e84de-34b7-4a1f-84df-06dc824b3e38 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:28.674386 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-bd2e84de-34b7-4a1f-84df-06dc824b3e38 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:28.680545 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd2e84de-34b7-4a1f-84df-06dc824b3e38 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:28.680990 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd2e84de-34b7-4a1f-84df-06dc824b3e38 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:28.682508 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd2e84de-34b7-4a1f-84df-06dc824b3e38 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:28.682508 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd2e84de-34b7-4a1f-84df-06dc824b3e38 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:28.813868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-bd2e84de-34b7-4a1f-84df-06dc824b3e38 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:28.821462 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-bd2e84de-34b7-4a1f-84df-06dc824b3e38 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.152210 Jul 07 15:36:28.822026 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 221/442] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:28 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:28.865208 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b2c8aa65-bf0b-48ac-98cb-42c25345fc59 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:28.865819 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b2c8aa65-bf0b-48ac-98cb-42c25345fc59 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:28.871858 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b2c8aa65-bf0b-48ac-98cb-42c25345fc59 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:28.872310 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b2c8aa65-bf0b-48ac-98cb-42c25345fc59 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:28.873067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b2c8aa65-bf0b-48ac-98cb-42c25345fc59 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:28.873499 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b2c8aa65-bf0b-48ac-98cb-42c25345fc59 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:28.938720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b2c8aa65-bf0b-48ac-98cb-42c25345fc59 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:28.940293 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b2c8aa65-bf0b-48ac-98cb-42c25345fc59 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1249 microversion: 2.1 time: 0.079607 Jul 07 15:36:28.940851 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 222/443] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:28 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:28.984312 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:28.984920 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:28.990930 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:28.991378 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:28.992188 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:28.992617 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:29.123788 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:29.132134 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:29.134005 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:29.135160 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ef0d35bf-9893-49e4-ac00-d5e2b7c36800 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.155029 Jul 07 15:36:29.135781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 222/444] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:28 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:29.838806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6fc47619-3bf6-4a9c-8091-b0457d226bce tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:29.839149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6fc47619-3bf6-4a9c-8091-b0457d226bce tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:29.845386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6fc47619-3bf6-4a9c-8091-b0457d226bce tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:29.846524 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6fc47619-3bf6-4a9c-8091-b0457d226bce tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:29.847291 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6fc47619-3bf6-4a9c-8091-b0457d226bce tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:29.847753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6fc47619-3bf6-4a9c-8091-b0457d226bce tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:29.957699 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-01927239-3fe8-460c-9771-55d93cda79f5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:29.959359 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-01927239-3fe8-460c-9771-55d93cda79f5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:29.965940 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-01927239-3fe8-460c-9771-55d93cda79f5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:29.966721 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-01927239-3fe8-460c-9771-55d93cda79f5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:29.968417 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-01927239-3fe8-460c-9771-55d93cda79f5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:29.969134 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-01927239-3fe8-460c-9771-55d93cda79f5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:29.986605 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6fc47619-3bf6-4a9c-8091-b0457d226bce tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:29.994467 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6fc47619-3bf6-4a9c-8091-b0457d226bce tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1470 microversion: 2.1 time: 0.160054 Jul 07 15:36:29.995031 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 223/445] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:29 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:30.032485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-01927239-3fe8-460c-9771-55d93cda79f5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:30.035949 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:30.040510 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-01927239-3fe8-460c-9771-55d93cda79f5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1297 microversion: 2.1 time: 0.086965 Jul 07 15:36:30.041113 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 223/446] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:29 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:30.155947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:30.158652 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:30.165805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:30.166256 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:30.168504 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:30.168504 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:30.269666 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-e12d0a3b-3a2f-45be-9be8-f4eceb382ba8 req-7b2e5e28-8cc6-40a5-9e0c-0c1c28171058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbefda7a-a7a6-418c-a5a2-abaf6451ef7a", "name": "network-vif-deleted", "tag": "52b419cf-1015-4084-93af-9e336d123a8d"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:30.279661 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-e12d0a3b-3a2f-45be-9be8-f4eceb382ba8 req-7b2e5e28-8cc6-40a5-9e0c-0c1c28171058 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:30.280859 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-e12d0a3b-3a2f-45be-9be8-f4eceb382ba8 req-7b2e5e28-8cc6-40a5-9e0c-0c1c28171058 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:30.293254 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-e12d0a3b-3a2f-45be-9be8-f4eceb382ba8 req-7b2e5e28-8cc6-40a5-9e0c-0c1c28171058 service nova] Creating event network-vif-deleted:52b419cf-1015-4084-93af-9e336d123a8d for instance dbefda7a-a7a6-418c-a5a2-abaf6451ef7a on hv-cinder-84130 Jul 07 15:36:30.298800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-e12d0a3b-3a2f-45be-9be8-f4eceb382ba8 req-7b2e5e28-8cc6-40a5-9e0c-0c1c28171058 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034459 Jul 07 15:36:30.299398 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 224/447] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:36:30.347768 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:30.357886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:30.359385 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:30.361267 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ad529978-df75-430f-955a-23091f4d14fa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.209917 Jul 07 15:36:30.363952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 224/448] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:30 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:30.946910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2029745719", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-888789777", "security_groups": [{"name": "tempest-secgroup-smoke-1112910285"}], "networks": [{"uuid": "757ed358-1381-4fc5-bef5-a1b2bca8fd1b"}], "block_device_mapping_v2": [{"uuid": "72f8e7a3-1e5d-4828-9ae0-944ada73d988", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:31.012861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:31.013464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:31.020043 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:31.020485 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:31.021388 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:31.021817 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:31.056483 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:31.061979 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:31.061979 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lazy-loading 'fault' on Instance uuid dbefda7a-a7a6-418c-a5a2-abaf6451ef7a {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:36:31.095304 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] validate_networks() for [('757ed358-1381-4fc5-bef5-a1b2bca8fd1b', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:36:31.114299 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3256d562f0a64600baeb215ebff4190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42fb18bea524ba980012973ec2a9ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:31.121952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-be646775-58ef-4def-95f9-46a779536604 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 200 len: 1304 microversion: 2.1 time: 0.113271 Jul 07 15:36:31.131621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 225/449] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:31 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:31.131621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-805a1d4b-e7bf-42e2-bc3b-a6bc43d6d834 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:31.131621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-805a1d4b-e7bf-42e2-bc3b-a6bc43d6d834 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:31.135777 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-805a1d4b-e7bf-42e2-bc3b-a6bc43d6d834 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:31.136610 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-805a1d4b-e7bf-42e2-bc3b-a6bc43d6d834 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:31.137002 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-805a1d4b-e7bf-42e2-bc3b-a6bc43d6d834 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:31.137433 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-805a1d4b-e7bf-42e2-bc3b-a6bc43d6d834 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:31.225428 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-805a1d4b-e7bf-42e2-bc3b-a6bc43d6d834 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:31.239335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-805a1d4b-e7bf-42e2-bc3b-a6bc43d6d834 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1303 microversion: 2.1 time: 0.114547 Jul 07 15:36:31.240638 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 226/450] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:31 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:31.379811 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:31.380528 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:31.391064 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:31.391757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:31.392591 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:31.393019 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:31.598850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:36:31.599336 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:36:31.599907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:36:31.600585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:36:31.601903 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:36:31.611869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:31.614145 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:31.614589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:31.615525 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:31.615980 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:31.622082 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:31.623721 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:31.625071 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3245b97b-0d63-4ac7-a774-3a8f00df584b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.250015 Jul 07 15:36:31.634174 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Getting quotas for project 41be827d61314cdbb5387c24e6353bb5. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:36:31.636372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:31.636902 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 227/451] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:31 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:31.638641 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Getting quotas for user 4a7231c86e1a4c4bb851f317a935079d and project 41be827d61314cdbb5387c24e6353bb5. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:36:31.699118 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:36:31.700450 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72f8e7a3-1e5d-4828-9ae0-944ada73d988',volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:36:32.072416 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-808dc494-2bc2-40ad-ba61-de70420eab45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.128687 Jul 07 15:36:32.072416 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 225/452] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:36:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:36:32.082590 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-60db5b6d-4e82-44ab-aee2-c1977f58b429 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:32.083368 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-60db5b6d-4e82-44ab-aee2-c1977f58b429 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:32.139772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-60db5b6d-4e82-44ab-aee2-c1977f58b429 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:32.145351 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:32.146529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] [instance: dbefda7a-a7a6-418c-a5a2-abaf6451ef7a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:32.149992 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-60db5b6d-4e82-44ab-aee2-c1977f58b429 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1088 microversion: 2.1 time: 0.069924 Jul 07 15:36:32.149992 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 228/453] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:32 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:32.166405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:32.166948 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:32.167833 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:32.168527 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:32.183823 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] HTTP exception thrown: Instance dbefda7a-a7a6-418c-a5a2-abaf6451ef7a could not be found. Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Request method failure captured: Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a HTTP/1.1 Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv1Yik0Mrmhmvjw73b-YgYR7JeZhK9bQ2_2A6FWHEtkduGmhAYDuTsd_mp4ITxH4RDIty_h6HMINayks06HkB9DLtuB4I3_lfe26ePr0JpMupOsdrSOi5h4GMXU5kZjK5Seqau34Hht9XDL012X7rPAZnhhxEEDOmbnil8cUWHfFDp8 Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: b42fb18bea524ba980012973ec2a9ee2 Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-VolumesNegativeTest-482327951 Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:36:32.185636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b42fb18bea524ba980012973ec2a9ee2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b42fb18bea524ba980012973ec2a9ee2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b42fb18bea524ba980012973ec2a9ee2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b42fb18bea524ba980012973ec2a9ee2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-VolumesNegativeTest-482327951 Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: b42fb18bea524ba980012973ec2a9ee2 Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-VolumesNegativeTest-482327951 Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-VolumesNegativeTest-482327951-project Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 3256d562f0a64600baeb215ebff4190d Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-VolumesNegativeTest-482327951-project Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance dbefda7a-a7a6-418c-a5a2-abaf6451ef7a could not be found. Jul 07 15:36:32.194360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'dbefda7a-a7a6-418c-a5a2-abaf6451ef7a'} Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbefda7a-a7a6-418c-a5a2-abaf6451ef7a could not be found. Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:36:32.195347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbefda7a-a7a6-418c-a5a2-abaf6451ef7a could not be found. Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbefda7a-a7a6-418c-a5a2-abaf6451ef7a could not be found. Jul 07 15:36:32.196790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:32.197907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] Returning 404 to user: Instance dbefda7a-a7a6-418c-a5a2-abaf6451ef7a could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:36:32.197907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-41b7e2fe-d963-472c-93a1-c4ce4df7a413 tempest-VolumesNegativeTest-482327951 tempest-VolumesNegativeTest-482327951-project] 10.222.0.25 "GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a" status: 404 len: 111 microversion: 2.1 time: 0.047278 Jul 07 15:36:32.197907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 226/454] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:32 2022] GET /compute/v2.1/servers/dbefda7a-a7a6-418c-a5a2-abaf6451ef7a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:36:32.257434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-779d12f5-af35-4579-9027-719c59406d04 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:32.261734 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-779d12f5-af35-4579-9027-719c59406d04 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:32.264316 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-779d12f5-af35-4579-9027-719c59406d04 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:32.264767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-779d12f5-af35-4579-9027-719c59406d04 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:32.265611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-779d12f5-af35-4579-9027-719c59406d04 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:32.266236 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-779d12f5-af35-4579-9027-719c59406d04 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:32.313935 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-3f6afde5-297f-4c7f-884a-11775c16fd3f req-42a6e56c-4276-4302-bcaf-c1419927d91e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05028730-a81d-4edf-a4e2-96d672547be4", "tag": "1b1ff111-abae-4beb-8edb-da235fcc08f4"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:32.327470 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-3f6afde5-297f-4c7f-884a-11775c16fd3f req-42a6e56c-4276-4302-bcaf-c1419927d91e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:32.329020 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-3f6afde5-297f-4c7f-884a-11775c16fd3f req-42a6e56c-4276-4302-bcaf-c1419927d91e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:32.345984 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-3f6afde5-297f-4c7f-884a-11775c16fd3f req-42a6e56c-4276-4302-bcaf-c1419927d91e service nova] Creating event network-changed:1b1ff111-abae-4beb-8edb-da235fcc08f4 for instance 05028730-a81d-4edf-a4e2-96d672547be4 on hv-cinder-84130 Jul 07 15:36:32.350985 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-3f6afde5-297f-4c7f-884a-11775c16fd3f req-42a6e56c-4276-4302-bcaf-c1419927d91e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040746 Jul 07 15:36:32.352065 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 227/455] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:36:32.441681 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-779d12f5-af35-4579-9027-719c59406d04 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:32.449827 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-779d12f5-af35-4579-9027-719c59406d04 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1371 microversion: 2.1 time: 0.196135 Jul 07 15:36:32.450334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 229/456] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:32 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:32.645514 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:32.646416 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:32.654571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:32.655184 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:32.656115 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:32.656603 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:32.804560 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:32.813123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:32.818910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:32.818910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1679efd6-36bf-47ed-8e27-d9a8fcd88412 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.176093 Jul 07 15:36:32.818910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 228/457] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:32 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:33.166768 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-03612772-6f82-48d4-9b8d-f02bf97de6c6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:33.167381 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-03612772-6f82-48d4-9b8d-f02bf97de6c6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:33.221764 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-03612772-6f82-48d4-9b8d-f02bf97de6c6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:33.228726 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-03612772-6f82-48d4-9b8d-f02bf97de6c6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1088 microversion: 2.1 time: 0.066348 Jul 07 15:36:33.229283 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 230/458] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:33 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:33.466779 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cb89fb17-7437-4d91-b5d6-6f4c6e083a71 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:33.467438 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cb89fb17-7437-4d91-b5d6-6f4c6e083a71 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:33.474129 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cb89fb17-7437-4d91-b5d6-6f4c6e083a71 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:33.474573 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cb89fb17-7437-4d91-b5d6-6f4c6e083a71 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:33.475323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cb89fb17-7437-4d91-b5d6-6f4c6e083a71 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:33.475806 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cb89fb17-7437-4d91-b5d6-6f4c6e083a71 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:33.622289 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cb89fb17-7437-4d91-b5d6-6f4c6e083a71 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:33.629964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cb89fb17-7437-4d91-b5d6-6f4c6e083a71 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1371 microversion: 2.1 time: 0.167080 Jul 07 15:36:33.630552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 229/459] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:33 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:33.835041 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:33.835680 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:33.841709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:33.842155 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:33.842907 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:33.843454 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:33.982524 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:33.991467 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:33.992997 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:33.994139 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-77152b37-84d7-4a7e-8e80-75af32c41990 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.163016 Jul 07 15:36:33.995305 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 231/460] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:33 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:34.246421 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6a3341f9-3390-42e1-8a83-9f34e6c75831 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:34.247081 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6a3341f9-3390-42e1-8a83-9f34e6c75831 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:34.254200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6a3341f9-3390-42e1-8a83-9f34e6c75831 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:34.254713 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6a3341f9-3390-42e1-8a83-9f34e6c75831 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:34.255490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6a3341f9-3390-42e1-8a83-9f34e6c75831 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:34.256054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6a3341f9-3390-42e1-8a83-9f34e6c75831 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:34.318853 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6a3341f9-3390-42e1-8a83-9f34e6c75831 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:34.327095 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6a3341f9-3390-42e1-8a83-9f34e6c75831 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1130 microversion: 2.1 time: 0.084697 Jul 07 15:36:34.327750 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 230/461] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:34 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1130 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:34.647113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1ca848ea-075c-40aa-a831-16ade1c2d3e9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:34.647936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1ca848ea-075c-40aa-a831-16ade1c2d3e9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:34.650390 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:34.655464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1ca848ea-075c-40aa-a831-16ade1c2d3e9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:34.656805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1ca848ea-075c-40aa-a831-16ade1c2d3e9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:34.656805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1ca848ea-075c-40aa-a831-16ade1c2d3e9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:34.657103 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1ca848ea-075c-40aa-a831-16ade1c2d3e9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:34.797551 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1ca848ea-075c-40aa-a831-16ade1c2d3e9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:34.808758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1ca848ea-075c-40aa-a831-16ade1c2d3e9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1371 microversion: 2.1 time: 0.163485 Jul 07 15:36:34.809353 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 232/462] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:34 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:35.014102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:35.014726 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:35.021063 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:35.021502 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:35.022251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:35.022676 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:35.152343 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:35.160649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:35.162136 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:35.163345 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-be22356a-9fba-4d80-aaf7-071fefb81af2 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.153055 Jul 07 15:36:35.163924 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 231/463] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:35 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:35.350630 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-753d9764-bb95-4b5b-b1f9-e1e853006dc1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:35.351421 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-753d9764-bb95-4b5b-b1f9-e1e853006dc1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:35.360253 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-753d9764-bb95-4b5b-b1f9-e1e853006dc1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:35.360789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-753d9764-bb95-4b5b-b1f9-e1e853006dc1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:35.362337 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-753d9764-bb95-4b5b-b1f9-e1e853006dc1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:35.362983 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-753d9764-bb95-4b5b-b1f9-e1e853006dc1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:35.393798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:35.436598 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-753d9764-bb95-4b5b-b1f9-e1e853006dc1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:35.444289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-753d9764-bb95-4b5b-b1f9-e1e853006dc1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1130 microversion: 2.1 time: 0.099900 Jul 07 15:36:35.444851 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 233/464] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:35 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1130 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:35.826393 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0959cacd-3dcc-4194-8f7e-9963897c268e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:35.827009 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0959cacd-3dcc-4194-8f7e-9963897c268e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:35.834092 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0959cacd-3dcc-4194-8f7e-9963897c268e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:35.834536 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0959cacd-3dcc-4194-8f7e-9963897c268e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:35.835320 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0959cacd-3dcc-4194-8f7e-9963897c268e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:35.835784 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0959cacd-3dcc-4194-8f7e-9963897c268e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:35.984338 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0959cacd-3dcc-4194-8f7e-9963897c268e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:35.991907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0959cacd-3dcc-4194-8f7e-9963897c268e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1371 microversion: 2.1 time: 0.169693 Jul 07 15:36:35.992479 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 232/465] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:35 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:36.182113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:36.182724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:36.189576 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:36.190022 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:36.190790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:36.191217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:36.341921 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:36.350793 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:36.352406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:36.353655 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f09199f5-7a28-485c-9a38-325ecd34f482 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.175554 Jul 07 15:36:36.354279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 234/466] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:36 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:36.461006 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-699e74bc-bd36-4e28-8df3-5b2f597ee449 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:36.461612 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-699e74bc-bd36-4e28-8df3-5b2f597ee449 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:36.468086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-699e74bc-bd36-4e28-8df3-5b2f597ee449 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:36.468626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-699e74bc-bd36-4e28-8df3-5b2f597ee449 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:36.469273 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-699e74bc-bd36-4e28-8df3-5b2f597ee449 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:36.474516 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-699e74bc-bd36-4e28-8df3-5b2f597ee449 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:36.532460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-699e74bc-bd36-4e28-8df3-5b2f597ee449 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:36.540592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-699e74bc-bd36-4e28-8df3-5b2f597ee449 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1130 microversion: 2.1 time: 0.083364 Jul 07 15:36:36.541152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 233/467] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:36 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1130 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:37.008628 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-156c3553-4b5d-486d-8873-60af6a5ad1a6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:37.009304 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-156c3553-4b5d-486d-8873-60af6a5ad1a6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:37.015359 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-156c3553-4b5d-486d-8873-60af6a5ad1a6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:37.015842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-156c3553-4b5d-486d-8873-60af6a5ad1a6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:37.016592 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-156c3553-4b5d-486d-8873-60af6a5ad1a6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:37.017016 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-156c3553-4b5d-486d-8873-60af6a5ad1a6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:37.148737 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-156c3553-4b5d-486d-8873-60af6a5ad1a6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:37.156213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-156c3553-4b5d-486d-8873-60af6a5ad1a6 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1371 microversion: 2.1 time: 0.151461 Jul 07 15:36:37.156777 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 235/468] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:37 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:37.371699 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:37.372328 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:37.378258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:37.378700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:37.379534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:37.380029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:37.507180 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:37.515536 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:37.517587 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:37.518713 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-30f795dd-ca4c-49c4-a82a-e9aea9378cb0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.151016 Jul 07 15:36:37.519269 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 234/469] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:37 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:37.556940 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-738e6f32-58a6-460a-bdbe-fca41a503b84 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:37.557539 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-738e6f32-58a6-460a-bdbe-fca41a503b84 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:37.563510 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-738e6f32-58a6-460a-bdbe-fca41a503b84 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:37.564516 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-738e6f32-58a6-460a-bdbe-fca41a503b84 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:37.565258 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-738e6f32-58a6-460a-bdbe-fca41a503b84 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:37.565686 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-738e6f32-58a6-460a-bdbe-fca41a503b84 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:37.628600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-738e6f32-58a6-460a-bdbe-fca41a503b84 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:37.630744 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:37.636618 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-738e6f32-58a6-460a-bdbe-fca41a503b84 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1130 microversion: 2.1 time: 0.083444 Jul 07 15:36:37.637334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 236/470] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:37 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1130 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:37.825669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-48eb0c75-cdfa-46ab-8788-0cc63b38ce4b req-a0993514-9fdf-4280-84eb-705a123ab83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05028730-a81d-4edf-a4e2-96d672547be4", "name": "network-vif-plugged", "status": "completed", "tag": "1b1ff111-abae-4beb-8edb-da235fcc08f4"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:37.835942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-48eb0c75-cdfa-46ab-8788-0cc63b38ce4b req-a0993514-9fdf-4280-84eb-705a123ab83c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:37.836381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-48eb0c75-cdfa-46ab-8788-0cc63b38ce4b req-a0993514-9fdf-4280-84eb-705a123ab83c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:37.847801 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-48eb0c75-cdfa-46ab-8788-0cc63b38ce4b req-a0993514-9fdf-4280-84eb-705a123ab83c service nova] Creating event network-vif-plugged:1b1ff111-abae-4beb-8edb-da235fcc08f4 for instance 05028730-a81d-4edf-a4e2-96d672547be4 on hv-cinder-84130 Jul 07 15:36:37.852805 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-48eb0c75-cdfa-46ab-8788-0cc63b38ce4b req-a0993514-9fdf-4280-84eb-705a123ab83c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032731 Jul 07 15:36:37.853382 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 235/471] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:38.173334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e4d2bcdf-a246-4bd9-9d85-ca435286b274 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:38.173942 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e4d2bcdf-a246-4bd9-9d85-ca435286b274 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:38.180497 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4d2bcdf-a246-4bd9-9d85-ca435286b274 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:38.180947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4d2bcdf-a246-4bd9-9d85-ca435286b274 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:38.181708 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4d2bcdf-a246-4bd9-9d85-ca435286b274 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:38.182138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4d2bcdf-a246-4bd9-9d85-ca435286b274 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:38.311265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e4d2bcdf-a246-4bd9-9d85-ca435286b274 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:38.319724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e4d2bcdf-a246-4bd9-9d85-ca435286b274 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1371 microversion: 2.1 time: 0.150211 Jul 07 15:36:38.320295 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 237/472] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:38 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:38.537294 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:38.537979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:38.544167 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:38.544614 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:38.545369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:38.545802 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:38.654522 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-aea4392f-0e7d-4315-a25a-297d2432fd27 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:38.655224 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-aea4392f-0e7d-4315-a25a-297d2432fd27 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:38.664041 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-aea4392f-0e7d-4315-a25a-297d2432fd27 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:38.664773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-aea4392f-0e7d-4315-a25a-297d2432fd27 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:38.665692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-aea4392f-0e7d-4315-a25a-297d2432fd27 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:38.666336 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-aea4392f-0e7d-4315-a25a-297d2432fd27 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:38.697843 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:38.708411 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:38.710212 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:38.711387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d876ed10-c3a7-4f84-90a3-7ffc8458feff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.179342 Jul 07 15:36:38.712051 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 236/473] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:38 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:38.733923 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-aea4392f-0e7d-4315-a25a-297d2432fd27 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:38.742114 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-aea4392f-0e7d-4315-a25a-297d2432fd27 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1130 microversion: 2.1 time: 0.092395 Jul 07 15:36:38.742670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 238/474] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:38 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1130 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:39.336638 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-78d2fc30-2d32-4340-9959-103fff5abaa7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:39.337247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-78d2fc30-2d32-4340-9959-103fff5abaa7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:39.343309 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-78d2fc30-2d32-4340-9959-103fff5abaa7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:39.343719 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-78d2fc30-2d32-4340-9959-103fff5abaa7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:39.344472 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-78d2fc30-2d32-4340-9959-103fff5abaa7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:39.344923 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-78d2fc30-2d32-4340-9959-103fff5abaa7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:39.489811 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-78d2fc30-2d32-4340-9959-103fff5abaa7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:39.497167 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-78d2fc30-2d32-4340-9959-103fff5abaa7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1371 microversion: 2.1 time: 0.164254 Jul 07 15:36:39.497725 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 237/475] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:39 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:39.729735 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:39.730724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:39.737340 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:39.737859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:39.738682 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:39.739178 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:39.759660 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8271c2a5-7917-4791-870e-d63ed5961116 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:39.760279 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8271c2a5-7917-4791-870e-d63ed5961116 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:39.767438 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8271c2a5-7917-4791-870e-d63ed5961116 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:39.767918 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8271c2a5-7917-4791-870e-d63ed5961116 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:39.768690 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8271c2a5-7917-4791-870e-d63ed5961116 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:39.769127 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8271c2a5-7917-4791-870e-d63ed5961116 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:39.842688 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8271c2a5-7917-4791-870e-d63ed5961116 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:39.850916 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8271c2a5-7917-4791-870e-d63ed5961116 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1130 microversion: 2.1 time: 0.096074 Jul 07 15:36:39.851491 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 238/476] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:39 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1130 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:39.912700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:39.921221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:39.922726 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:39.924540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a112f70e-e567-411c-8b9a-65e8253b812f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.198867 Jul 07 15:36:39.928079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 239/477] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:39 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:40.514384 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-50008f50-558e-41a0-a51e-2c2d7de6d2ff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:40.515106 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-50008f50-558e-41a0-a51e-2c2d7de6d2ff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:40.521772 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-50008f50-558e-41a0-a51e-2c2d7de6d2ff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:40.522868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-50008f50-558e-41a0-a51e-2c2d7de6d2ff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:40.523740 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-50008f50-558e-41a0-a51e-2c2d7de6d2ff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:40.524328 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-50008f50-558e-41a0-a51e-2c2d7de6d2ff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:40.691537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-50008f50-558e-41a0-a51e-2c2d7de6d2ff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:40.701445 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-50008f50-558e-41a0-a51e-2c2d7de6d2ff tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1371 microversion: 2.1 time: 0.190902 Jul 07 15:36:40.702355 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 239/478] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:40 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:40.867957 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9fddce39-4474-46ed-ab03-19b6433d480e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:40.868562 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9fddce39-4474-46ed-ab03-19b6433d480e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:40.874901 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9fddce39-4474-46ed-ab03-19b6433d480e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:40.875354 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9fddce39-4474-46ed-ab03-19b6433d480e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:40.876473 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9fddce39-4474-46ed-ab03-19b6433d480e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:40.877686 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9fddce39-4474-46ed-ab03-19b6433d480e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:40.942623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:40.943283 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:40.950339 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:40.954241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:40.954241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:40.954241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:40.970151 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9fddce39-4474-46ed-ab03-19b6433d480e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:40.982305 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9fddce39-4474-46ed-ab03-19b6433d480e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1186 microversion: 2.1 time: 0.117824 Jul 07 15:36:40.983059 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 240/479] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:40 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1186 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:41.139407 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:41.153919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:41.153919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:41.153919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0e81c97d-3e93-4db9-aa2e-0aea2fd403bf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.213908 Jul 07 15:36:41.154324 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 240/480] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:40 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:36:41.721277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d32f6fd1-d832-4cfc-a9fe-d185fe55ab50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:41.721859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d32f6fd1-d832-4cfc-a9fe-d185fe55ab50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:41.736798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d32f6fd1-d832-4cfc-a9fe-d185fe55ab50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:41.739733 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d32f6fd1-d832-4cfc-a9fe-d185fe55ab50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:41.741571 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d32f6fd1-d832-4cfc-a9fe-d185fe55ab50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:41.746712 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d32f6fd1-d832-4cfc-a9fe-d185fe55ab50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:41.999847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c86932d0-dc61-4265-a45c-06985410e8d0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:42.001052 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c86932d0-dc61-4265-a45c-06985410e8d0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:42.004083 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:42.004983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=6 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:42.006025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d32f6fd1-d832-4cfc-a9fe-d185fe55ab50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:42.015220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d32f6fd1-d832-4cfc-a9fe-d185fe55ab50 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1371 microversion: 2.1 time: 0.299943 Jul 07 15:36:42.025571 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 241/481] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:41 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:42.026677 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c86932d0-dc61-4265-a45c-06985410e8d0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:42.027216 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c86932d0-dc61-4265-a45c-06985410e8d0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:42.033471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c86932d0-dc61-4265-a45c-06985410e8d0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:42.033471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c86932d0-dc61-4265-a45c-06985410e8d0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:42.101611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c86932d0-dc61-4265-a45c-06985410e8d0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:42.113390 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c86932d0-dc61-4265-a45c-06985410e8d0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1204 microversion: 2.1 time: 0.115981 Jul 07 15:36:42.114412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 241/482] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:41 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1204 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:42.170575 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:42.172077 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:42.181606 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:42.181606 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:42.182162 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:42.182779 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:42.401030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:42.414068 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:42.415947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:42.417393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-601f007f-0106-48b9-a01f-1b405f581938 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.251103 Jul 07 15:36:42.418116 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 242/483] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:42 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:42.984890 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b36af74e-1cd8-4b11-b6fe-82b3d08f5268 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:42.985537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b36af74e-1cd8-4b11-b6fe-82b3d08f5268 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:42.996193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b36af74e-1cd8-4b11-b6fe-82b3d08f5268 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:42.996744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b36af74e-1cd8-4b11-b6fe-82b3d08f5268 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:42.997690 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b36af74e-1cd8-4b11-b6fe-82b3d08f5268 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:42.998236 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b36af74e-1cd8-4b11-b6fe-82b3d08f5268 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.034415 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d4f57134-8b1e-4abe-a103-eb358870d506 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:43.035014 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d4f57134-8b1e-4abe-a103-eb358870d506 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:43.045903 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d4f57134-8b1e-4abe-a103-eb358870d506 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.048180 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d4f57134-8b1e-4abe-a103-eb358870d506 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.049265 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b36af74e-1cd8-4b11-b6fe-82b3d08f5268 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2/ips" status: 200 len: 149 microversion: 2.1 time: 0.066777 Jul 07 15:36:43.049692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d4f57134-8b1e-4abe-a103-eb358870d506 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.050835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 242/484] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:36:42 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2/ips => generated 149 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:43.053277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d4f57134-8b1e-4abe-a103-eb358870d506 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.063142 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1995abe-b0e4-41da-a0ab-d99fde564625"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:43.065429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:43.073652 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.074555 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.075653 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.076293 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.186553 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Invalid volume: volume f1995abe-b0e4-41da-a0ab-d99fde564625 is already attached to instances: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: POST /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2/os-volume_attachments HTTP/1.1 Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 74 Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:36:43.190691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {"volumeAttachment": {"volumeId": "f1995abe-b0e4-41da-a0ab-d99fde564625"}} Jul 07 15:36:43.192365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Invalid volume: volume f1995abe-b0e4-41da-a0ab-d99fde564625 is already attached to instances: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'server_id': '004cd795-a6e3-47b5-ba46-8f24751e8ec2', 'body': {'volumeAttachment': {'volumeId': 'f1995abe-b0e4-41da-a0ab-d99fde564625'}}} Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f1995abe-b0e4-41da-a0ab-d99fde564625 is already attached to instances: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:43.193241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f1995abe-b0e4-41da-a0ab-d99fde564625 is already attached to instances: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:43.196109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:43.198998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:43.198998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:36:43.198998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:36:43.198998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f1995abe-b0e4-41da-a0ab-d99fde564625 is already attached to instances: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 Jul 07 15:36:43.198998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:36:43.198998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 400 to user: Invalid volume: volume f1995abe-b0e4-41da-a0ab-d99fde564625 is already attached to instances: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:36:43.198998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d75e377b-534a-4c33-a948-d0fafc255b21 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135226 Jul 07 15:36:43.198998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 243/485] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:36:43 2022] POST /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 07 15:36:43.201110 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2c2b8595-a32c-416c-a05d-6a531e84dddc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:43.201110 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2c2b8595-a32c-416c-a05d-6a531e84dddc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:43.206976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2c2b8595-a32c-416c-a05d-6a531e84dddc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.207699 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2c2b8595-a32c-416c-a05d-6a531e84dddc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.208708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2c2b8595-a32c-416c-a05d-6a531e84dddc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.209456 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2c2b8595-a32c-416c-a05d-6a531e84dddc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.214015 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:43.228929 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=12 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:43.377671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d4f57134-8b1e-4abe-a103-eb358870d506 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:43.386890 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d4f57134-8b1e-4abe-a103-eb358870d506 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1564 microversion: 2.1 time: 0.357414 Jul 07 15:36:43.389615 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 243/486] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:43 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1564 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:43.394977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6d0bbb1a-59f4-4fb3-9995-0ca7d5499a9e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:43.395866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6d0bbb1a-59f4-4fb3-9995-0ca7d5499a9e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:43.402106 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d0bbb1a-59f4-4fb3-9995-0ca7d5499a9e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.402551 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d0bbb1a-59f4-4fb3-9995-0ca7d5499a9e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.403505 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d0bbb1a-59f4-4fb3-9995-0ca7d5499a9e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.403966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d0bbb1a-59f4-4fb3-9995-0ca7d5499a9e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.443747 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6d0bbb1a-59f4-4fb3-9995-0ca7d5499a9e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:36:43.499342 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2c2b8595-a32c-416c-a05d-6a531e84dddc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:43.508862 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2c2b8595-a32c-416c-a05d-6a531e84dddc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1272 microversion: 2.1 time: 0.314525 Jul 07 15:36:43.509649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 244/487] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:43 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:43.514740 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1461a820-956c-451c-bdc3-81483e49cbb0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:43.515404 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1461a820-956c-451c-bdc3-81483e49cbb0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:43.522253 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1461a820-956c-451c-bdc3-81483e49cbb0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.522898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1461a820-956c-451c-bdc3-81483e49cbb0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.523866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1461a820-956c-451c-bdc3-81483e49cbb0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.524461 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1461a820-956c-451c-bdc3-81483e49cbb0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.614309 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1461a820-956c-451c-bdc3-81483e49cbb0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103390 Jul 07 15:36:43.614909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 245/488] 10.222.0.25 () {58 vars in 1274 bytes} [Thu Jul 7 15:36:43 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:43.620727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:43.621522 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:43.629758 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.633484 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.633484 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.633484 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.824441 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6d0bbb1a-59f4-4fb3-9995-0ca7d5499a9e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 204 len: 0 microversion: 2.1 time: 0.433469 Jul 07 15:36:43.829605 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 244/489] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:36:43 2022] DELETE /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:36:43.835066 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3ce8d9cc-8c13-4521-b03d-a59df2ca30be tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:43.835806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3ce8d9cc-8c13-4521-b03d-a59df2ca30be tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:43.853375 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9cc-8c13-4521-b03d-a59df2ca30be tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.854132 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9cc-8c13-4521-b03d-a59df2ca30be tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.854928 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9cc-8c13-4521-b03d-a59df2ca30be tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:43.855665 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9cc-8c13-4521-b03d-a59df2ca30be tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:43.987898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:43.999069 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:44.000996 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:44.003196 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e0769e1a-128f-493b-9236-49823ccc1616 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.387064 Jul 07 15:36:44.003953 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 246/490] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:43 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:44.099930 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3ce8d9cc-8c13-4521-b03d-a59df2ca30be tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:44.111052 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3ce8d9cc-8c13-4521-b03d-a59df2ca30be tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1679 microversion: 2.1 time: 0.280417 Jul 07 15:36:44.111832 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 245/491] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:43 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1679 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:44.272399 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-9a3659fe-6ccb-49d2-afa3-528d51d4a3f0 req-04ed351e-5bbc-4d2d-a40e-2187bf0693ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8af2eb-fd79-4b8d-a9ef-648a1959ded8", "tag": "bcf3a191-4ef0-4048-9b74-408448e7ee6d"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:44.290727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-9a3659fe-6ccb-49d2-afa3-528d51d4a3f0 req-04ed351e-5bbc-4d2d-a40e-2187bf0693ae service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:44.291173 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-9a3659fe-6ccb-49d2-afa3-528d51d4a3f0 req-04ed351e-5bbc-4d2d-a40e-2187bf0693ae service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:44.308921 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-a0dcc9f4-8e7d-4f52-8602-22bc6678244a req-c5aecf71-f715-45a0-9c1b-9eac8670d835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e85e6b3-ebad-441e-afcd-31692b27b782", "name": "network-vif-plugged", "status": "completed", "tag": "8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:44.327006 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-a0dcc9f4-8e7d-4f52-8602-22bc6678244a req-c5aecf71-f715-45a0-9c1b-9eac8670d835 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:44.330170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-a0dcc9f4-8e7d-4f52-8602-22bc6678244a req-c5aecf71-f715-45a0-9c1b-9eac8670d835 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:44.332439 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-9a3659fe-6ccb-49d2-afa3-528d51d4a3f0 req-04ed351e-5bbc-4d2d-a40e-2187bf0693ae service nova] Creating event network-changed:bcf3a191-4ef0-4048-9b74-408448e7ee6d for instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 on hv-cinder-84130 Jul 07 15:36:44.346041 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-9a3659fe-6ccb-49d2-afa3-528d51d4a3f0 req-04ed351e-5bbc-4d2d-a40e-2187bf0693ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077148 Jul 07 15:36:44.350207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 247/492] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:44.356471 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-a0dcc9f4-8e7d-4f52-8602-22bc6678244a req-c5aecf71-f715-45a0-9c1b-9eac8670d835 service nova] Creating event network-vif-plugged:8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a for instance 2e85e6b3-ebad-441e-afcd-31692b27b782 on hv-cinder-84130 Jul 07 15:36:44.363238 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-a0dcc9f4-8e7d-4f52-8602-22bc6678244a req-c5aecf71-f715-45a0-9c1b-9eac8670d835 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058394 Jul 07 15:36:44.364419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 246/493] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:36:44.527388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9098dffa-eea4-4a79-a46d-828c7ecb73f6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:44.528275 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9098dffa-eea4-4a79-a46d-828c7ecb73f6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:44.535271 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9098dffa-eea4-4a79-a46d-828c7ecb73f6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:44.535773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9098dffa-eea4-4a79-a46d-828c7ecb73f6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:44.540002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9098dffa-eea4-4a79-a46d-828c7ecb73f6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:44.540002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9098dffa-eea4-4a79-a46d-828c7ecb73f6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:44.696784 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9098dffa-eea4-4a79-a46d-828c7ecb73f6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:44.705501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9098dffa-eea4-4a79-a46d-828c7ecb73f6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.182117 Jul 07 15:36:44.707782 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 248/494] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:44 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:45.023498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:45.024166 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:45.030902 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:45.031344 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:45.032175 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:45.033978 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:45.128573 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0ebc2288-e3af-492d-a983-f159f7fe1390 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:45.129190 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0ebc2288-e3af-492d-a983-f159f7fe1390 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:45.135543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0ebc2288-e3af-492d-a983-f159f7fe1390 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:45.136245 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0ebc2288-e3af-492d-a983-f159f7fe1390 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:45.137029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0ebc2288-e3af-492d-a983-f159f7fe1390 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:45.138548 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0ebc2288-e3af-492d-a983-f159f7fe1390 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:45.493835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:45.503904 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:45.505893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:45.507492 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7d6c830b-c50d-47a5-b374-e950faf15852 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.488863 Jul 07 15:36:45.519434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 247/495] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:45 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:45.574923 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0ebc2288-e3af-492d-a983-f159f7fe1390 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:45.586529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0ebc2288-e3af-492d-a983-f159f7fe1390 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1679 microversion: 2.1 time: 0.461484 Jul 07 15:36:45.587500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 249/496] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:45 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1679 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:45.712419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-590105c1-c2a9-4dc1-8512-7a36c3e5dd43 req-d4a283c6-2fcd-4695-a8b5-ca4a7a0c45f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05028730-a81d-4edf-a4e2-96d672547be4", "tag": "1b1ff111-abae-4beb-8edb-da235fcc08f4"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:45.728495 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-46b5be82-abdc-4bfd-b3f0-5b4b5f2d9106 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:45.729324 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-46b5be82-abdc-4bfd-b3f0-5b4b5f2d9106 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:45.741060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-590105c1-c2a9-4dc1-8512-7a36c3e5dd43 req-d4a283c6-2fcd-4695-a8b5-ca4a7a0c45f5 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:45.742794 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46b5be82-abdc-4bfd-b3f0-5b4b5f2d9106 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:45.743060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-590105c1-c2a9-4dc1-8512-7a36c3e5dd43 req-d4a283c6-2fcd-4695-a8b5-ca4a7a0c45f5 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:45.744010 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46b5be82-abdc-4bfd-b3f0-5b4b5f2d9106 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:45.746318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46b5be82-abdc-4bfd-b3f0-5b4b5f2d9106 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:45.748028 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46b5be82-abdc-4bfd-b3f0-5b4b5f2d9106 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:45.772211 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-590105c1-c2a9-4dc1-8512-7a36c3e5dd43 req-d4a283c6-2fcd-4695-a8b5-ca4a7a0c45f5 service nova] Creating event network-changed:1b1ff111-abae-4beb-8edb-da235fcc08f4 for instance 05028730-a81d-4edf-a4e2-96d672547be4 on hv-cinder-84130 Jul 07 15:36:45.789335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-590105c1-c2a9-4dc1-8512-7a36c3e5dd43 req-d4a283c6-2fcd-4695-a8b5-ca4a7a0c45f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076701 Jul 07 15:36:45.792200 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 248/497] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:46.282723 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-46b5be82-abdc-4bfd-b3f0-5b4b5f2d9106 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:46.291350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-46b5be82-abdc-4bfd-b3f0-5b4b5f2d9106 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.568228 Jul 07 15:36:46.292516 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 250/498] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:45 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:46.526695 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:46.528235 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:46.535786 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:46.536568 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:46.537578 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:46.538220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:46.609056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-33d70c67-f036-49ec-b4ed-9e772feda25d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:46.610370 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-33d70c67-f036-49ec-b4ed-9e772feda25d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:46.616942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33d70c67-f036-49ec-b4ed-9e772feda25d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:46.617592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33d70c67-f036-49ec-b4ed-9e772feda25d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:46.618538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33d70c67-f036-49ec-b4ed-9e772feda25d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:46.619127 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33d70c67-f036-49ec-b4ed-9e772feda25d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:46.930143 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:46.942434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:46.944445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:46.946741 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-33d70c67-f036-49ec-b4ed-9e772feda25d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:46.947791 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-27062d91-ba43-45e6-955b-f7d8cc8b90a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.425112 Jul 07 15:36:46.948796 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 249/499] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:46 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:46.955518 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-33d70c67-f036-49ec-b4ed-9e772feda25d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1679 microversion: 2.1 time: 0.353689 Jul 07 15:36:46.956412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 251/500] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:46 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1679 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:47.311134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0d2df668-b947-4fcd-be6b-ae8586e9907e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:47.312711 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0d2df668-b947-4fcd-be6b-ae8586e9907e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:47.322943 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d2df668-b947-4fcd-be6b-ae8586e9907e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:47.323464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d2df668-b947-4fcd-be6b-ae8586e9907e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:47.324490 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d2df668-b947-4fcd-be6b-ae8586e9907e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:47.325143 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d2df668-b947-4fcd-be6b-ae8586e9907e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:47.573069 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0d2df668-b947-4fcd-be6b-ae8586e9907e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:47.592109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0d2df668-b947-4fcd-be6b-ae8586e9907e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.285920 Jul 07 15:36:47.594159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 250/501] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:47 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:47.975075 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4fe63d73-4c15-47e9-a296-04762914911b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:47.978616 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:47.980111 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4fe63d73-4c15-47e9-a296-04762914911b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:47.981166 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:48.019234 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4fe63d73-4c15-47e9-a296-04762914911b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:48.019697 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4fe63d73-4c15-47e9-a296-04762914911b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:48.020473 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4fe63d73-4c15-47e9-a296-04762914911b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:48.020902 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4fe63d73-4c15-47e9-a296-04762914911b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:48.029676 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:48.030122 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:48.033595 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:48.034037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:48.174061 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4fe63d73-4c15-47e9-a296-04762914911b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:48.183025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4fe63d73-4c15-47e9-a296-04762914911b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1612 microversion: 2.1 time: 0.214164 Jul 07 15:36:48.192418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 251/502] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:47 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1612 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:48.241392 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-2508a0a3-0a4b-4454-a1a9-256f4f645e3f req-949f93d9-b417-4d41-b284-3c8bbab23486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004cd795-a6e3-47b5-ba46-8f24751e8ec2", "name": "network-vif-deleted", "tag": "0af4a4b2-ec67-4920-a522-06b353a6ccc2"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:48.250334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-2508a0a3-0a4b-4454-a1a9-256f4f645e3f req-949f93d9-b417-4d41-b284-3c8bbab23486 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:48.256305 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-2508a0a3-0a4b-4454-a1a9-256f4f645e3f req-949f93d9-b417-4d41-b284-3c8bbab23486 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:48.283861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-2508a0a3-0a4b-4454-a1a9-256f4f645e3f req-949f93d9-b417-4d41-b284-3c8bbab23486 service nova] Creating event network-vif-deleted:0af4a4b2-ec67-4920-a522-06b353a6ccc2 for instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 on hv-cinder-84130 Jul 07 15:36:48.304183 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-2508a0a3-0a4b-4454-a1a9-256f4f645e3f req-949f93d9-b417-4d41-b284-3c8bbab23486 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059915 Jul 07 15:36:48.305395 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 252/503] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:48.384555 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:48.399515 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:48.401555 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:48.403064 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ae45ebac-184c-421e-a662-e91b3bb1358e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.435465 Jul 07 15:36:48.404242 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 252/504] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:47 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:48.610174 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-656add7a-7af8-4690-95cc-33481d1ad4f0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:48.612275 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-656add7a-7af8-4690-95cc-33481d1ad4f0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:48.624044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-656add7a-7af8-4690-95cc-33481d1ad4f0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:48.629844 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-656add7a-7af8-4690-95cc-33481d1ad4f0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:48.630545 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-656add7a-7af8-4690-95cc-33481d1ad4f0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:48.631123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-656add7a-7af8-4690-95cc-33481d1ad4f0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:48.870096 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-656add7a-7af8-4690-95cc-33481d1ad4f0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:48.872927 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:48.895960 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-656add7a-7af8-4690-95cc-33481d1ad4f0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.284048 Jul 07 15:36:48.895960 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 253/505] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:48 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:49.210692 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:49.211915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:49.220563 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:49.221229 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:49.222169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:49.223221 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:49.261038 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:49.261488 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:49.262248 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lazy-loading 'fault' on Instance uuid 004cd795-a6e3-47b5-ba46-8f24751e8ec2 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:36:49.317052 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:49.326292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9e7f51d2-a7cf-43cb-9506-963e15cf6612 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 200 len: 1330 microversion: 2.1 time: 0.121200 Jul 07 15:36:49.328302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 253/506] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:49 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 1330 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:49.421681 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:49.422278 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:49.429935 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:49.430380 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:49.431142 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:49.431590 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:49.576461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:49.587597 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:49.589293 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:49.590496 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-dc11dffa-e9d3-4a26-84af-90154b90f59c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1808 microversion: 2.20 time: 0.173011 Jul 07 15:36:49.591070 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 254/507] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:49 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:49.917483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b746b9c4-2563-4525-b890-27ce20991cee tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:49.917483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b746b9c4-2563-4525-b890-27ce20991cee tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:49.948885 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b746b9c4-2563-4525-b890-27ce20991cee tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:49.948885 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b746b9c4-2563-4525-b890-27ce20991cee tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:49.948885 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b746b9c4-2563-4525-b890-27ce20991cee tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:49.948885 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b746b9c4-2563-4525-b890-27ce20991cee tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:50.147283 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b746b9c4-2563-4525-b890-27ce20991cee tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:50.155236 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b746b9c4-2563-4525-b890-27ce20991cee tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.248657 Jul 07 15:36:50.155836 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 254/508] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:49 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:50.346253 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:50.346787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:50.366693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:50.367157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:50.368194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:50.369023 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:50.399530 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 HTTP/1.1 Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:36:50.401876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:36:50.403426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '004cd795-a6e3-47b5-ba46-8f24751e8ec2'} Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:36:50.404202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:36:50.405455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:50.406524 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:36:50.406524 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ad40c11f-6bbf-40f4-bc9b-bdfad88f5a41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 404 len: 111 microversion: 2.1 time: 0.063506 Jul 07 15:36:50.410499 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 255/509] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:50 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:36:50.413117 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2e594805-bc3c-486b-ad3d-7e5bc1a4fb16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '.version_select at 0x7f5248f76040>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:50.536315 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2e594805-bc3c-486b-ad3d-7e5bc1a4fb16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595673043" status: 202 len: 0 microversion: 2.1 time: 0.126960 Jul 07 15:36:50.537342 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 255/510] 10.222.0.25 () {58 vars in 1217 bytes} [Thu Jul 7 15:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595673043 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:36:50.609306 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:50.609918 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:50.616310 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:50.616759 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:50.617531 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:50.617972 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:50.934671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:50.944130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:50.946081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:50.947729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d174ed1b-553a-4cc1-b9b3-d126e254c152 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1795 microversion: 2.20 time: 0.342808 Jul 07 15:36:50.948828 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 256/511] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:36:50 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1795 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:36:51.174473 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-81e47149-fe8c-4aaa-a9e2-e572560a9b48 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:51.175151 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-81e47149-fe8c-4aaa-a9e2-e572560a9b48 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:51.181683 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-81e47149-fe8c-4aaa-a9e2-e572560a9b48 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:51.182142 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-81e47149-fe8c-4aaa-a9e2-e572560a9b48 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:51.182955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-81e47149-fe8c-4aaa-a9e2-e572560a9b48 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:51.183393 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-81e47149-fe8c-4aaa-a9e2-e572560a9b48 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:51.361705 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-81e47149-fe8c-4aaa-a9e2-e572560a9b48 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:51.375857 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-81e47149-fe8c-4aaa-a9e2-e572560a9b48 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.203051 Jul 07 15:36:51.377415 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 256/512] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:51 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:51.585647 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-db58555b-9c9c-40de-b05e-1d9ebe927fc8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:51.586329 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-db58555b-9c9c-40de-b05e-1d9ebe927fc8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:51.596455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-db58555b-9c9c-40de-b05e-1d9ebe927fc8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:51.596982 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-db58555b-9c9c-40de-b05e-1d9ebe927fc8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:51.597953 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-db58555b-9c9c-40de-b05e-1d9ebe927fc8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:51.598417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-db58555b-9c9c-40de-b05e-1d9ebe927fc8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:51.743544 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-db58555b-9c9c-40de-b05e-1d9ebe927fc8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lazy-loading 'services' on Instance uuid 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:36:52.028296 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-db58555b-9c9c-40de-b05e-1d9ebe927fc8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments/f1995abe-b0e4-41da-a0ab-d99fde564625" status: 202 len: 0 microversion: 2.1 time: 0.446167 Jul 07 15:36:52.032553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 257/513] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:36:51 2022] DELETE /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments/f1995abe-b0e4-41da-a0ab-d99fde564625 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:36:52.045054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-268f6b9a-a827-48f1-81c0-a59c51f9cc41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:52.046089 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-268f6b9a-a827-48f1-81c0-a59c51f9cc41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:52.053329 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-268f6b9a-a827-48f1-81c0-a59c51f9cc41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:52.054046 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-268f6b9a-a827-48f1-81c0-a59c51f9cc41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:52.054869 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-268f6b9a-a827-48f1-81c0-a59c51f9cc41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:52.055300 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-268f6b9a-a827-48f1-81c0-a59c51f9cc41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:52.087865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-268f6b9a-a827-48f1-81c0-a59c51f9cc41 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053529 Jul 07 15:36:52.088428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 257/514] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:36:52 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:52.394577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9faba0e1-f826-48ca-af04-35a31d48108c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:52.395305 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9faba0e1-f826-48ca-af04-35a31d48108c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:52.401880 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9faba0e1-f826-48ca-af04-35a31d48108c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:52.402457 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9faba0e1-f826-48ca-af04-35a31d48108c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:52.403376 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9faba0e1-f826-48ca-af04-35a31d48108c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:52.403832 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9faba0e1-f826-48ca-af04-35a31d48108c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:52.737312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9faba0e1-f826-48ca-af04-35a31d48108c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:52.747339 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9faba0e1-f826-48ca-af04-35a31d48108c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.356808 Jul 07 15:36:52.748030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 258/515] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:52 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:53.100525 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-29bc34af-a870-49a3-b6d8-c0827858abe2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:53.103299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-29bc34af-a870-49a3-b6d8-c0827858abe2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:53.116658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-29bc34af-a870-49a3-b6d8-c0827858abe2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:53.117411 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-29bc34af-a870-49a3-b6d8-c0827858abe2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:53.118583 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-29bc34af-a870-49a3-b6d8-c0827858abe2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:53.119190 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-29bc34af-a870-49a3-b6d8-c0827858abe2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:53.199321 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-29bc34af-a870-49a3-b6d8-c0827858abe2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102677 Jul 07 15:36:53.199993 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 258/516] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:36:53 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:53.764609 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e2275bfc-9033-457b-8c29-1befeb98de4c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:53.765218 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e2275bfc-9033-457b-8c29-1befeb98de4c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:53.773223 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e2275bfc-9033-457b-8c29-1befeb98de4c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:53.777938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e2275bfc-9033-457b-8c29-1befeb98de4c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:53.777938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e2275bfc-9033-457b-8c29-1befeb98de4c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:53.777938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e2275bfc-9033-457b-8c29-1befeb98de4c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:53.918703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e2275bfc-9033-457b-8c29-1befeb98de4c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:53.927031 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e2275bfc-9033-457b-8c29-1befeb98de4c tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.166250 Jul 07 15:36:53.927626 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 259/517] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:53 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:54.211982 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b9475732-d327-4197-9fa2-086c95b32332 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:54.212902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b9475732-d327-4197-9fa2-086c95b32332 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:54.219768 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b9475732-d327-4197-9fa2-086c95b32332 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:54.220872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b9475732-d327-4197-9fa2-086c95b32332 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:54.221668 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b9475732-d327-4197-9fa2-086c95b32332 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:54.222104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b9475732-d327-4197-9fa2-086c95b32332 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:54.252864 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b9475732-d327-4197-9fa2-086c95b32332 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045628 Jul 07 15:36:54.257972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 259/518] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:36:54 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:36:54.317907 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-86e75d5d-42d5-4e04-b8b6-7d4496feaeb5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:54.318648 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-86e75d5d-42d5-4e04-b8b6-7d4496feaeb5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:54.324863 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-86e75d5d-42d5-4e04-b8b6-7d4496feaeb5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:54.325554 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-86e75d5d-42d5-4e04-b8b6-7d4496feaeb5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:54.326553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-86e75d5d-42d5-4e04-b8b6-7d4496feaeb5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:54.327113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-86e75d5d-42d5-4e04-b8b6-7d4496feaeb5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:54.353528 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-86e75d5d-42d5-4e04-b8b6-7d4496feaeb5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:36:54.651882 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-86e75d5d-42d5-4e04-b8b6-7d4496feaeb5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 204 len: 0 microversion: 2.1 time: 0.338011 Jul 07 15:36:54.652481 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 260/519] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:36:54 2022] DELETE /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:36:54.660695 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-dfc8684c-8da6-4f3b-8810-bd0613abc922 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:54.661302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-dfc8684c-8da6-4f3b-8810-bd0613abc922 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:54.667550 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dfc8684c-8da6-4f3b-8810-bd0613abc922 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:54.667902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dfc8684c-8da6-4f3b-8810-bd0613abc922 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:54.668611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dfc8684c-8da6-4f3b-8810-bd0613abc922 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:54.669044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dfc8684c-8da6-4f3b-8810-bd0613abc922 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:54.852169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-dfc8684c-8da6-4f3b-8810-bd0613abc922 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:54.861930 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-dfc8684c-8da6-4f3b-8810-bd0613abc922 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1681 microversion: 2.1 time: 0.205076 Jul 07 15:36:54.862514 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 260/520] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:54 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:54.947174 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-df37a74d-cda5-452a-88e3-48b841393045 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:54.948025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-df37a74d-cda5-452a-88e3-48b841393045 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:54.956880 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df37a74d-cda5-452a-88e3-48b841393045 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:54.957683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df37a74d-cda5-452a-88e3-48b841393045 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:54.958670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df37a74d-cda5-452a-88e3-48b841393045 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:54.959103 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df37a74d-cda5-452a-88e3-48b841393045 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:55.116086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-df37a74d-cda5-452a-88e3-48b841393045 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:55.123920 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-df37a74d-cda5-452a-88e3-48b841393045 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.183198 Jul 07 15:36:55.124592 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 261/521] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:54 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:55.877444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d1ec6b77-d8e2-4dbd-81aa-3082cca96bdd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Action: 'create', calling method: .version_select at 0x7f5248ecc040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-92263573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECLpiQmZzctm0Wo4ytWpl4Ap1wJGPgv1M1nqiCGR/VEk4yafWIC+NZIVtvZJud2dLTKnKvm668wE7vXDpPZSHQiF3jCdofhuPftyEc1wPS/wVjfmVjXp3UQmmRgWNUipg=="}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:55.879608 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-eb4b1014-da66-46ed-82e7-7ee33adbe6ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:55.880454 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-eb4b1014-da66-46ed-82e7-7ee33adbe6ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:55.887037 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eb4b1014-da66-46ed-82e7-7ee33adbe6ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:55.887644 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eb4b1014-da66-46ed-82e7-7ee33adbe6ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:55.888495 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eb4b1014-da66-46ed-82e7-7ee33adbe6ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:55.889000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eb4b1014-da66-46ed-82e7-7ee33adbe6ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:55.895996 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-d1ec6b77-d8e2-4dbd-81aa-3082cca96bdd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Getting quotas for project b72dae7a2e644460b4c63da884023c82. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:36:55.900411 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-d1ec6b77-d8e2-4dbd-81aa-3082cca96bdd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Getting quotas for user 05e0f1ddeb224677b18cfc769dc45d47 and project b72dae7a2e644460b4c63da884023c82. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:36:55.984720 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d1ec6b77-d8e2-4dbd-81aa-3082cca96bdd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.326830 Jul 07 15:36:55.986402 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 261/522] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:36:55 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:56.037720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-eb4b1014-da66-46ed-82e7-7ee33adbe6ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:56.046833 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-eb4b1014-da66-46ed-82e7-7ee33adbe6ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1681 microversion: 2.1 time: 0.171043 Jul 07 15:36:56.057152 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 262/523] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:55 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:56.140800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e13fe90b-dec9-4099-bc0a-d65da4fe9861 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:56.141500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e13fe90b-dec9-4099-bc0a-d65da4fe9861 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:56.148849 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e13fe90b-dec9-4099-bc0a-d65da4fe9861 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:56.149299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e13fe90b-dec9-4099-bc0a-d65da4fe9861 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:56.150061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e13fe90b-dec9-4099-bc0a-d65da4fe9861 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:56.150493 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e13fe90b-dec9-4099-bc0a-d65da4fe9861 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:56.289103 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e13fe90b-dec9-4099-bc0a-d65da4fe9861 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:56.296737 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e13fe90b-dec9-4099-bc0a-d65da4fe9861 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.159861 Jul 07 15:36:56.297577 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 262/524] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:56 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:56.653972 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7c22d234-2373-485c-aee9-87b35c2ca547 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:56.654542 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7c22d234-2373-485c-aee9-87b35c2ca547 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:56.661690 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7c22d234-2373-485c-aee9-87b35c2ca547 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:56.662136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7c22d234-2373-485c-aee9-87b35c2ca547 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:56.662890 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7c22d234-2373-485c-aee9-87b35c2ca547 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:56.663321 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7c22d234-2373-485c-aee9-87b35c2ca547 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:56.756644 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-7c22d234-2373-485c-aee9-87b35c2ca547 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lazy-loading 'services' on Instance uuid a5788db1-1101-4334-abdd-2f11d074751a {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:36:56.958176 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7c22d234-2373-485c-aee9-87b35c2ca547 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/os-volume_attachments/526e8700-392f-4aff-b051-11684eeb1909" status: 202 len: 0 microversion: 2.1 time: 0.307812 Jul 07 15:36:56.959883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 263/525] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:36:56 2022] DELETE /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/os-volume_attachments/526e8700-392f-4aff-b051-11684eeb1909 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:36:57.064841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-736421d0-52f8-471d-9041-d7669c752c84 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:57.065624 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-736421d0-52f8-471d-9041-d7669c752c84 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:57.072665 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-736421d0-52f8-471d-9041-d7669c752c84 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:57.073200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-736421d0-52f8-471d-9041-d7669c752c84 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:57.074047 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-736421d0-52f8-471d-9041-d7669c752c84 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:57.074484 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-736421d0-52f8-471d-9041-d7669c752c84 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:57.094518 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:57.258229 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-736421d0-52f8-471d-9041-d7669c752c84 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:57.272992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-736421d0-52f8-471d-9041-d7669c752c84 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1681 microversion: 2.1 time: 0.211851 Jul 07 15:36:57.277398 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 263/526] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:57 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:57.315931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-651906ff-cbb4-4101-bebc-4422af4a289b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:57.317244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-651906ff-cbb4-4101-bebc-4422af4a289b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:57.324175 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-651906ff-cbb4-4101-bebc-4422af4a289b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:57.325067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-651906ff-cbb4-4101-bebc-4422af4a289b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:57.325892 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-651906ff-cbb4-4101-bebc-4422af4a289b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:57.326383 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-651906ff-cbb4-4101-bebc-4422af4a289b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:57.514251 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-651906ff-cbb4-4101-bebc-4422af4a289b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:57.519763 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-651906ff-cbb4-4101-bebc-4422af4a289b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.208848 Jul 07 15:36:57.520552 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 264/527] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:57 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:57.868546 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-c4f866bb-559b-4958-ba93-f47b85814cc7 req-af79cda3-8887-43fb-92c3-70915a965b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1ae649-fd9a-4dcd-ae5a-384e324e4de9", "name": "network-vif-deleted", "tag": "81cf072b-a045-4379-a583-082f35faaaf6"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:57.880467 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:57.882727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-c4f866bb-559b-4958-ba93-f47b85814cc7 req-af79cda3-8887-43fb-92c3-70915a965b67 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:57.889178 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-c4f866bb-559b-4958-ba93-f47b85814cc7 req-af79cda3-8887-43fb-92c3-70915a965b67 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:57.901954 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-c4f866bb-559b-4958-ba93-f47b85814cc7 req-af79cda3-8887-43fb-92c3-70915a965b67 service nova] Creating event network-vif-deleted:81cf072b-a045-4379-a583-082f35faaaf6 for instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 on hv-cinder-84130 Jul 07 15:36:57.910695 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-c4f866bb-559b-4958-ba93-f47b85814cc7 req-af79cda3-8887-43fb-92c3-70915a965b67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045951 Jul 07 15:36:57.915022 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 264/528] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:58.091184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-11542b15-6e91-432c-9aca-de77c3cd0cc3 req-84c56778-1bd8-4744-8146-a400b2a48276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8af2eb-fd79-4b8d-a9ef-648a1959ded8", "name": "network-vif-plugged", "status": "completed", "tag": "bcf3a191-4ef0-4048-9b74-408448e7ee6d"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:58.100991 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-11542b15-6e91-432c-9aca-de77c3cd0cc3 req-84c56778-1bd8-4744-8146-a400b2a48276 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:58.101708 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-11542b15-6e91-432c-9aca-de77c3cd0cc3 req-84c56778-1bd8-4744-8146-a400b2a48276 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:58.115782 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-11542b15-6e91-432c-9aca-de77c3cd0cc3 req-84c56778-1bd8-4744-8146-a400b2a48276 service nova] Creating event network-vif-plugged:bcf3a191-4ef0-4048-9b74-408448e7ee6d for instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 on hv-cinder-84130 Jul 07 15:36:58.127594 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-11542b15-6e91-432c-9aca-de77c3cd0cc3 req-84c56778-1bd8-4744-8146-a400b2a48276 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035797 Jul 07 15:36:58.127594 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 265/529] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:36:58.160565 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-429eec0a-31dc-4491-bf89-74fbcea627e8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:36:58.191241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-429eec0a-31dc-4491-bf89-74fbcea627e8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:58.191759 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-429eec0a-31dc-4491-bf89-74fbcea627e8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:58.294935 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:58.301163 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:58.303419 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-429eec0a-31dc-4491-bf89-74fbcea627e8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Going to try to stop instance {{(pid=124720) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 07 15:36:58.306952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:58.307397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:58.308199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:58.309291 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:58.359780 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:58.360352 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:58.362088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lazy-loading 'fault' on Instance uuid 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:36:58.418713 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:58.427253 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-27acbb1e-4e3e-42e4-a8e8-a2cebb105382 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 200 len: 1330 microversion: 2.1 time: 0.136937 Jul 07 15:36:58.428536 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 266/530] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:58 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 1330 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:58.537156 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9364b467-d839-4f1a-b6e3-195986f8866f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:58.537862 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9364b467-d839-4f1a-b6e3-195986f8866f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:58.554258 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9364b467-d839-4f1a-b6e3-195986f8866f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:58.555023 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9364b467-d839-4f1a-b6e3-195986f8866f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:58.555987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9364b467-d839-4f1a-b6e3-195986f8866f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:58.556620 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9364b467-d839-4f1a-b6e3-195986f8866f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:58.569602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-429eec0a-31dc-4491-bf89-74fbcea627e8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/action" status: 202 len: 0 microversion: 2.1 time: 0.423835 Jul 07 15:36:58.573832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 265/531] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:36:58 2022] POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:36:58.582025 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7b73f3c8-7a96-409a-93d1-6414676fd5a5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:58.583015 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7b73f3c8-7a96-409a-93d1-6414676fd5a5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:58.590893 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b73f3c8-7a96-409a-93d1-6414676fd5a5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:58.591990 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b73f3c8-7a96-409a-93d1-6414676fd5a5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:58.593287 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b73f3c8-7a96-409a-93d1-6414676fd5a5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:58.593977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b73f3c8-7a96-409a-93d1-6414676fd5a5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:58.857099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9364b467-d839-4f1a-b6e3-195986f8866f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:58.866407 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9364b467-d839-4f1a-b6e3-195986f8866f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.333240 Jul 07 15:36:58.872736 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 267/532] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:58 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:36:58.916993 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7b73f3c8-7a96-409a-93d1-6414676fd5a5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:36:58.927935 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7b73f3c8-7a96-409a-93d1-6414676fd5a5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1674 microversion: 2.1 time: 0.352153 Jul 07 15:36:58.929148 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 266/533] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:58 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1674 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:36:59.446587 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:59.450556 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:59.463716 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:59.464683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:59.465749 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:59.466451 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:59.487458 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 HTTP/1.1 Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:36:59.494710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:36:59.496783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '6f1ae649-fd9a-4dcd-ae5a-384e324e4de9'} Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:36:59.497787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:36:59.499228 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:36:59.503898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:36:59.503898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0f790794-4e89-455a-a74b-3c455dc2b6fa tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 404 len: 111 microversion: 2.1 time: 0.053693 Jul 07 15:36:59.503898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 268/534] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:59 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:36:59.508287 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e0ee9d01-e9e2-4407-a7d6-32142c3cb5cf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '.version_select at 0x7f5248ecc0d0>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:59.635965 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e0ee9d01-e9e2-4407-a7d6-32142c3cb5cf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820827737" status: 202 len: 0 microversion: 2.1 time: 0.131479 Jul 07 15:36:59.636541 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 267/535] 10.222.0.25 () {58 vars in 1220 bytes} [Thu Jul 7 15:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820827737 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:36:59.888865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fd99c8f1-3d51-4a03-9d8b-849e44a8296b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:59.889652 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fd99c8f1-3d51-4a03-9d8b-849e44a8296b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:59.911222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fd99c8f1-3d51-4a03-9d8b-849e44a8296b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:59.911862 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fd99c8f1-3d51-4a03-9d8b-849e44a8296b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:59.915108 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fd99c8f1-3d51-4a03-9d8b-849e44a8296b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:59.916428 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fd99c8f1-3d51-4a03-9d8b-849e44a8296b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:59.929452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:36:59.950569 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-53e21758-ae15-46a5-a0b0-efd79069a558 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:36:59.951995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-53e21758-ae15-46a5-a0b0-efd79069a558 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:36:59.971366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-53e21758-ae15-46a5-a0b0-efd79069a558 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:59.973339 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-53e21758-ae15-46a5-a0b0-efd79069a558 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:36:59.976364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-53e21758-ae15-46a5-a0b0-efd79069a558 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:36:59.977583 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-53e21758-ae15-46a5-a0b0-efd79069a558 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:00.313177 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-53e21758-ae15-46a5-a0b0-efd79069a558 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:00.324657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-53e21758-ae15-46a5-a0b0-efd79069a558 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1674 microversion: 2.1 time: 0.380387 Jul 07 15:37:00.335601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 268/536] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:59 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1674 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:00.342086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-fd99c8f1-3d51-4a03-9d8b-849e44a8296b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:00.352542 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fd99c8f1-3d51-4a03-9d8b-849e44a8296b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1260 microversion: 2.1 time: 0.467544 Jul 07 15:37:00.353123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 269/537] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:36:59 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1260 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:00.842100 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6d7a38ec-0207-461f-b4b3-c62d5879d675 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: .version_select at 0x7f5248f08ee0>, body: {"keypair": {"name": "tempest-keypair-1226166688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcmqxIzHAFTbgyE927rdmHTPLnZT7Hit0NxE6nwqasqVEs591FTuTFMngcO8cMm0ncXsW94OI3UXiUxeVkokGGWiS79+cZzIdblGjTTKQkkys49iuTjkkUeNLYlaT/h/w=="}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:00.858091 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-6d7a38ec-0207-461f-b4b3-c62d5879d675 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:37:00.863366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-6d7a38ec-0207-461f-b4b3-c62d5879d675 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for user b2e09539caff4d4698cf29c1ea22d365 and project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:37:00.973700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6d7a38ec-0207-461f-b4b3-c62d5879d675 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135536 Jul 07 15:37:00.974662 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 269/538] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:37:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:01.347342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f3b7863d-69b8-4dbc-93f7-9f34854eea46 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:01.347973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f3b7863d-69b8-4dbc-93f7-9f34854eea46 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:01.354316 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f3b7863d-69b8-4dbc-93f7-9f34854eea46 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:01.355021 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f3b7863d-69b8-4dbc-93f7-9f34854eea46 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:01.356428 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f3b7863d-69b8-4dbc-93f7-9f34854eea46 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:01.357035 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f3b7863d-69b8-4dbc-93f7-9f34854eea46 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:01.371131 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-449ab26c-f384-424e-bf08-03e42b9aa69a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:01.371872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-449ab26c-f384-424e-bf08-03e42b9aa69a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:01.383768 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-449ab26c-f384-424e-bf08-03e42b9aa69a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:01.386285 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-449ab26c-f384-424e-bf08-03e42b9aa69a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:01.390181 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-449ab26c-f384-424e-bf08-03e42b9aa69a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:01.394472 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-449ab26c-f384-424e-bf08-03e42b9aa69a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:01.586751 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f3b7863d-69b8-4dbc-93f7-9f34854eea46 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:01.594340 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f3b7863d-69b8-4dbc-93f7-9f34854eea46 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1674 microversion: 2.1 time: 0.252025 Jul 07 15:37:01.595495 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 270/539] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:01 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1674 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:01.607208 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-449ab26c-f384-424e-bf08-03e42b9aa69a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:01.615658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-449ab26c-f384-424e-bf08-03e42b9aa69a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1444 microversion: 2.1 time: 0.250264 Jul 07 15:37:01.616217 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 270/540] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:01 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1444 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:01.632608 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2bfc7c0e-912e-42cb-9c58-26eb3276be92 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:01.633242 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2bfc7c0e-912e-42cb-9c58-26eb3276be92 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:01.639635 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2bfc7c0e-912e-42cb-9c58-26eb3276be92 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:01.640087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2bfc7c0e-912e-42cb-9c58-26eb3276be92 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:01.640860 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2bfc7c0e-912e-42cb-9c58-26eb3276be92 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:01.641290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2bfc7c0e-912e-42cb-9c58-26eb3276be92 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:01.777573 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2bfc7c0e-912e-42cb-9c58-26eb3276be92 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:01.788686 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2bfc7c0e-912e-42cb-9c58-26eb3276be92 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1444 microversion: 2.1 time: 0.160278 Jul 07 15:37:01.789276 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 271/541] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:01 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:02.613827 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-58f03ebf-fd2b-4cde-88fc-4d741dfbb6af tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:02.614434 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-58f03ebf-fd2b-4cde-88fc-4d741dfbb6af tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:02.621076 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-58f03ebf-fd2b-4cde-88fc-4d741dfbb6af tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:02.621519 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-58f03ebf-fd2b-4cde-88fc-4d741dfbb6af tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:02.622272 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-58f03ebf-fd2b-4cde-88fc-4d741dfbb6af tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:02.622698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-58f03ebf-fd2b-4cde-88fc-4d741dfbb6af tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:02.757938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-58f03ebf-fd2b-4cde-88fc-4d741dfbb6af tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:02.766042 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-58f03ebf-fd2b-4cde-88fc-4d741dfbb6af tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1674 microversion: 2.1 time: 0.156670 Jul 07 15:37:02.767173 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 271/542] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:02 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:03.786379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ce9e44bf-7955-48f9-ae9f-93962b23a258 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:03.787100 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ce9e44bf-7955-48f9-ae9f-93962b23a258 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:03.793350 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ce9e44bf-7955-48f9-ae9f-93962b23a258 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:03.793801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ce9e44bf-7955-48f9-ae9f-93962b23a258 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:03.794789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ce9e44bf-7955-48f9-ae9f-93962b23a258 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:03.795229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ce9e44bf-7955-48f9-ae9f-93962b23a258 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:03.931095 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ce9e44bf-7955-48f9-ae9f-93962b23a258 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:03.939017 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ce9e44bf-7955-48f9-ae9f-93962b23a258 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1674 microversion: 2.1 time: 0.156527 Jul 07 15:37:03.939615 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 272/543] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:03 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:04.411343 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-233127964", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac1a0dbf-9ce9-4f3d-9709-351b088f4833"}], "security_groups": [{"name": "tempest-securitygroup--726026908"}], "key_name": "tempest-keypair-1226166688", "user_data": "}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:04.521886 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] validate_networks() for [('ac1a0dbf-9ce9-4f3d-9709-351b088f4833', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:37:04.696594 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-21ee12ef-f7fa-42b8-8c13-3e2b71d55f35 req-e679457f-d5fd-4dba-8e36-72c5d6121924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8af2eb-fd79-4b8d-a9ef-648a1959ded8", "tag": "bcf3a191-4ef0-4048-9b74-408448e7ee6d"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:04.704201 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-21ee12ef-f7fa-42b8-8c13-3e2b71d55f35 req-e679457f-d5fd-4dba-8e36-72c5d6121924 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:04.704688 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-21ee12ef-f7fa-42b8-8c13-3e2b71d55f35 req-e679457f-d5fd-4dba-8e36-72c5d6121924 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:04.716530 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-21ee12ef-f7fa-42b8-8c13-3e2b71d55f35 req-e679457f-d5fd-4dba-8e36-72c5d6121924 service nova] Creating event network-changed:bcf3a191-4ef0-4048-9b74-408448e7ee6d for instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 on hv-cinder-84130 Jul 07 15:37:04.722619 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-21ee12ef-f7fa-42b8-8c13-3e2b71d55f35 req-e679457f-d5fd-4dba-8e36-72c5d6121924 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030171 Jul 07 15:37:04.723413 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 273/544] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:37:04.936583 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:37:04.937288 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:37:04.938152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:37:04.938827 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:37:04.939448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:37:04.949221 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:04.949887 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:04.950854 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:04.951848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:04.960396 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cb14773b-06f4-476c-af4c-5762b8fc7aae tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:04.965487 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cb14773b-06f4-476c-af4c-5762b8fc7aae tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:04.976848 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cb14773b-06f4-476c-af4c-5762b8fc7aae tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:04.977330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:37:04.977888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cb14773b-06f4-476c-af4c-5762b8fc7aae tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:04.978925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cb14773b-06f4-476c-af4c-5762b8fc7aae tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:04.979960 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cb14773b-06f4-476c-af4c-5762b8fc7aae tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:04.982508 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for user b2e09539caff4d4698cf29c1ea22d365 and project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:37:05.001832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:37:05.004168 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:37:05.138712 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cb14773b-06f4-476c-af4c-5762b8fc7aae tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:05.147523 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cb14773b-06f4-476c-af4c-5762b8fc7aae tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1674 microversion: 2.1 time: 0.194189 Jul 07 15:37:05.148295 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 274/545] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:04 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:05.218524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-60f134af-6360-4c93-912d-f3909411b030 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.813387 Jul 07 15:37:05.220518 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 272/546] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:37:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:37:05.230790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e56a0a1b-3d0d-4d62-8d0b-0bc8c830fd16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:05.231996 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e56a0a1b-3d0d-4d62-8d0b-0bc8c830fd16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:05.235433 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:05.347799 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e56a0a1b-3d0d-4d62-8d0b-0bc8c830fd16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:05.366790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e56a0a1b-3d0d-4d62-8d0b-0bc8c830fd16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1241 microversion: 2.1 time: 0.140042 Jul 07 15:37:05.367767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 275/547] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:05 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:06.166212 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6bb483f4-ee5d-4e8e-b1ff-b97118b70d89 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:06.166816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6bb483f4-ee5d-4e8e-b1ff-b97118b70d89 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:06.174693 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6bb483f4-ee5d-4e8e-b1ff-b97118b70d89 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:06.175064 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6bb483f4-ee5d-4e8e-b1ff-b97118b70d89 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:06.175853 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6bb483f4-ee5d-4e8e-b1ff-b97118b70d89 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:06.176306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6bb483f4-ee5d-4e8e-b1ff-b97118b70d89 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:06.312607 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6bb483f4-ee5d-4e8e-b1ff-b97118b70d89 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:06.320172 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6bb483f4-ee5d-4e8e-b1ff-b97118b70d89 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1674 microversion: 2.1 time: 0.158390 Jul 07 15:37:06.320739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 273/548] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:06 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:06.384986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e8be346c-ddb8-4f39-b546-f55d0d13e47e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:06.385598 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e8be346c-ddb8-4f39-b546-f55d0d13e47e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:06.396714 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e8be346c-ddb8-4f39-b546-f55d0d13e47e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:06.397265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e8be346c-ddb8-4f39-b546-f55d0d13e47e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:06.398139 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e8be346c-ddb8-4f39-b546-f55d0d13e47e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:06.400242 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e8be346c-ddb8-4f39-b546-f55d0d13e47e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:06.469141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e8be346c-ddb8-4f39-b546-f55d0d13e47e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:06.477300 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e8be346c-ddb8-4f39-b546-f55d0d13e47e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1245 microversion: 2.1 time: 0.096513 Jul 07 15:37:06.477913 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 276/549] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:06 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:07.337601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-62f189b7-7699-4eae-95fb-a5bdc24193ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:07.338366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-62f189b7-7699-4eae-95fb-a5bdc24193ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:07.345187 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-62f189b7-7699-4eae-95fb-a5bdc24193ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:07.345629 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-62f189b7-7699-4eae-95fb-a5bdc24193ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:07.346496 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-62f189b7-7699-4eae-95fb-a5bdc24193ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:07.346924 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-62f189b7-7699-4eae-95fb-a5bdc24193ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:07.493577 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-62f189b7-7699-4eae-95fb-a5bdc24193ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:07.494102 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f239ba7c-aa41-4fb2-85e7-cde0ae243abb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:07.496487 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f239ba7c-aa41-4fb2-85e7-cde0ae243abb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:07.501835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-62f189b7-7699-4eae-95fb-a5bdc24193ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1674 microversion: 2.1 time: 0.168548 Jul 07 15:37:07.503631 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 274/550] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:07 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:07.503766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f239ba7c-aa41-4fb2-85e7-cde0ae243abb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:07.503766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f239ba7c-aa41-4fb2-85e7-cde0ae243abb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:07.503766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f239ba7c-aa41-4fb2-85e7-cde0ae243abb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:07.504134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f239ba7c-aa41-4fb2-85e7-cde0ae243abb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:07.572787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f239ba7c-aa41-4fb2-85e7-cde0ae243abb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:07.580984 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f239ba7c-aa41-4fb2-85e7-cde0ae243abb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1311 microversion: 2.1 time: 0.090592 Jul 07 15:37:07.581556 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 277/551] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:07 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:08.518780 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-84f269bb-6f86-459d-8037-cbc5f944999f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:08.519517 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-84f269bb-6f86-459d-8037-cbc5f944999f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:08.526737 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-84f269bb-6f86-459d-8037-cbc5f944999f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:08.527189 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-84f269bb-6f86-459d-8037-cbc5f944999f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:08.527995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-84f269bb-6f86-459d-8037-cbc5f944999f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:08.528424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-84f269bb-6f86-459d-8037-cbc5f944999f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:08.598486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-630c575d-0021-4402-af3b-f912c8d6dd10 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:08.599215 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-630c575d-0021-4402-af3b-f912c8d6dd10 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:08.605636 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-630c575d-0021-4402-af3b-f912c8d6dd10 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:08.606347 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-630c575d-0021-4402-af3b-f912c8d6dd10 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:08.607106 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-630c575d-0021-4402-af3b-f912c8d6dd10 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:08.607532 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-630c575d-0021-4402-af3b-f912c8d6dd10 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:08.714961 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-84f269bb-6f86-459d-8037-cbc5f944999f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:08.730193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-84f269bb-6f86-459d-8037-cbc5f944999f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1674 microversion: 2.1 time: 0.215660 Jul 07 15:37:08.730802 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 275/552] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:08 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1674 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:08.778091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-630c575d-0021-4402-af3b-f912c8d6dd10 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:08.786461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-630c575d-0021-4402-af3b-f912c8d6dd10 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1366 microversion: 2.1 time: 0.191835 Jul 07 15:37:08.787518 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 278/553] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:08 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:09.049316 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-44a256ba-321b-448e-91b3-8adbe6068d55 req-8ab284f1-8b6a-4f0a-9c98-c2df12a49e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285e8356-8fad-43f7-ae21-52104c0b453f", "tag": "e7e5d408-0caa-4043-a605-2348d4827ea2"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:09.082235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-44a256ba-321b-448e-91b3-8adbe6068d55 req-8ab284f1-8b6a-4f0a-9c98-c2df12a49e2c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:09.082735 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-44a256ba-321b-448e-91b3-8adbe6068d55 req-8ab284f1-8b6a-4f0a-9c98-c2df12a49e2c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:09.099224 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-44a256ba-321b-448e-91b3-8adbe6068d55 req-8ab284f1-8b6a-4f0a-9c98-c2df12a49e2c service nova] Creating event network-changed:e7e5d408-0caa-4043-a605-2348d4827ea2 for instance 285e8356-8fad-43f7-ae21-52104c0b453f on hv-cinder-84130 Jul 07 15:37:09.104373 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-44a256ba-321b-448e-91b3-8adbe6068d55 req-8ab284f1-8b6a-4f0a-9c98-c2df12a49e2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059161 Jul 07 15:37:09.105431 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 276/554] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:09.749092 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-200a50bb-af09-4f79-ac9f-9d2b273007ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:09.749791 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-200a50bb-af09-4f79-ac9f-9d2b273007ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:09.756472 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-200a50bb-af09-4f79-ac9f-9d2b273007ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:09.756920 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-200a50bb-af09-4f79-ac9f-9d2b273007ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:09.757775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-200a50bb-af09-4f79-ac9f-9d2b273007ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:09.758152 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-200a50bb-af09-4f79-ac9f-9d2b273007ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:09.804992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-067fdddf-0b7b-4f16-8034-e52ead1265e8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:09.805972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-067fdddf-0b7b-4f16-8034-e52ead1265e8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:09.819332 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-067fdddf-0b7b-4f16-8034-e52ead1265e8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:09.819963 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-067fdddf-0b7b-4f16-8034-e52ead1265e8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:09.821176 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-067fdddf-0b7b-4f16-8034-e52ead1265e8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:09.821709 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-067fdddf-0b7b-4f16-8034-e52ead1265e8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:09.963078 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-200a50bb-af09-4f79-ac9f-9d2b273007ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:09.972268 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-200a50bb-af09-4f79-ac9f-9d2b273007ea tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1651 microversion: 2.1 time: 0.226999 Jul 07 15:37:09.972988 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 279/555] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:09 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1651 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:09.990648 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1d4be829-4a55-4397-b4fc-4737f25be007 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:09.996682 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1d4be829-4a55-4397-b4fc-4737f25be007 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:09.997125 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1d4be829-4a55-4397-b4fc-4737f25be007 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:10.006753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-067fdddf-0b7b-4f16-8034-e52ead1265e8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:10.014483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-067fdddf-0b7b-4f16-8034-e52ead1265e8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1366 microversion: 2.1 time: 0.213631 Jul 07 15:37:10.014970 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 277/556] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:09 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:10.024814 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1d4be829-4a55-4397-b4fc-4737f25be007 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Going to try to start instance {{(pid=124719) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 07 15:37:10.174599 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1d4be829-4a55-4397-b4fc-4737f25be007 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/action" status: 202 len: 0 microversion: 2.1 time: 0.187797 Jul 07 15:37:10.175333 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 280/557] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:37:09 2022] POST /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 15:37:10.196642 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d50b9867-e7fe-4908-8483-3ad9458e9f7e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:10.197264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d50b9867-e7fe-4908-8483-3ad9458e9f7e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:10.208697 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d50b9867-e7fe-4908-8483-3ad9458e9f7e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:10.209963 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d50b9867-e7fe-4908-8483-3ad9458e9f7e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:10.209963 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d50b9867-e7fe-4908-8483-3ad9458e9f7e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:10.210341 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d50b9867-e7fe-4908-8483-3ad9458e9f7e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:10.367512 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d50b9867-e7fe-4908-8483-3ad9458e9f7e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:10.376873 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d50b9867-e7fe-4908-8483-3ad9458e9f7e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1660 microversion: 2.1 time: 0.195997 Jul 07 15:37:10.377570 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 278/558] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:10 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1660 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:11.032902 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7f557408-c410-4172-af4b-7304fab7e0f0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:11.033600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7f557408-c410-4172-af4b-7304fab7e0f0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:11.039931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7f557408-c410-4172-af4b-7304fab7e0f0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:11.040382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7f557408-c410-4172-af4b-7304fab7e0f0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:11.041157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7f557408-c410-4172-af4b-7304fab7e0f0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:11.041590 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7f557408-c410-4172-af4b-7304fab7e0f0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:11.170720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7f557408-c410-4172-af4b-7304fab7e0f0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:11.178920 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7f557408-c410-4172-af4b-7304fab7e0f0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1366 microversion: 2.1 time: 0.150869 Jul 07 15:37:11.179475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 281/559] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:11 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:11.397940 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ac816036-b010-4616-8f8e-0b5049ad8a7c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:11.398475 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ac816036-b010-4616-8f8e-0b5049ad8a7c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:11.404942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ac816036-b010-4616-8f8e-0b5049ad8a7c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:11.405383 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ac816036-b010-4616-8f8e-0b5049ad8a7c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:11.406140 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ac816036-b010-4616-8f8e-0b5049ad8a7c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:11.406574 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ac816036-b010-4616-8f8e-0b5049ad8a7c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:11.537579 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ac816036-b010-4616-8f8e-0b5049ad8a7c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:11.545141 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ac816036-b010-4616-8f8e-0b5049ad8a7c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1660 microversion: 2.1 time: 0.151299 Jul 07 15:37:11.545699 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 279/560] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:11 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1660 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:12.195635 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9b67777c-1c0f-4004-971f-cdcaa374683f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:12.196158 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9b67777c-1c0f-4004-971f-cdcaa374683f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:12.202235 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b67777c-1c0f-4004-971f-cdcaa374683f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:12.202682 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b67777c-1c0f-4004-971f-cdcaa374683f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:12.203450 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b67777c-1c0f-4004-971f-cdcaa374683f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:12.203907 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b67777c-1c0f-4004-971f-cdcaa374683f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:12.355024 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9b67777c-1c0f-4004-971f-cdcaa374683f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:12.362591 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9b67777c-1c0f-4004-971f-cdcaa374683f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1366 microversion: 2.1 time: 0.170877 Jul 07 15:37:12.363346 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 282/561] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:12 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:12.562279 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8be50261-9981-446e-a484-d269e42bf617 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:12.562835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8be50261-9981-446e-a484-d269e42bf617 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:12.569856 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8be50261-9981-446e-a484-d269e42bf617 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:12.570303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8be50261-9981-446e-a484-d269e42bf617 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:12.571059 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8be50261-9981-446e-a484-d269e42bf617 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:12.571490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8be50261-9981-446e-a484-d269e42bf617 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:12.698432 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8be50261-9981-446e-a484-d269e42bf617 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:12.706488 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8be50261-9981-446e-a484-d269e42bf617 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1660 microversion: 2.1 time: 0.148186 Jul 07 15:37:12.707045 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 280/562] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:12 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1660 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:13.380918 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b9442467-2d03-43f6-8591-cb90ef95b43e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:13.382136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b9442467-2d03-43f6-8591-cb90ef95b43e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:13.388123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b9442467-2d03-43f6-8591-cb90ef95b43e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:13.388572 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b9442467-2d03-43f6-8591-cb90ef95b43e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:13.389475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b9442467-2d03-43f6-8591-cb90ef95b43e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:13.390076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b9442467-2d03-43f6-8591-cb90ef95b43e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:13.532400 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b9442467-2d03-43f6-8591-cb90ef95b43e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:13.539909 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b9442467-2d03-43f6-8591-cb90ef95b43e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1366 microversion: 2.1 time: 0.162761 Jul 07 15:37:13.540475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 283/563] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:13 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:13.723907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-bbad5090-30b2-4528-abfd-b6c21ca15fe3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:13.724509 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-bbad5090-30b2-4528-abfd-b6c21ca15fe3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:13.730925 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bbad5090-30b2-4528-abfd-b6c21ca15fe3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:13.731670 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bbad5090-30b2-4528-abfd-b6c21ca15fe3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:13.732636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bbad5090-30b2-4528-abfd-b6c21ca15fe3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:13.733209 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bbad5090-30b2-4528-abfd-b6c21ca15fe3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:13.865331 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-bbad5090-30b2-4528-abfd-b6c21ca15fe3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:13.872788 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-bbad5090-30b2-4528-abfd-b6c21ca15fe3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1664 microversion: 2.1 time: 0.153177 Jul 07 15:37:13.873350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 281/564] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:13 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:14.557130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b65bceb8-deb1-4ff3-948b-e054c52e288e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:14.557729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b65bceb8-deb1-4ff3-948b-e054c52e288e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:14.564298 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b65bceb8-deb1-4ff3-948b-e054c52e288e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:14.564779 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b65bceb8-deb1-4ff3-948b-e054c52e288e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:14.565594 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b65bceb8-deb1-4ff3-948b-e054c52e288e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:14.566048 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b65bceb8-deb1-4ff3-948b-e054c52e288e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:14.708020 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b65bceb8-deb1-4ff3-948b-e054c52e288e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:14.716091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b65bceb8-deb1-4ff3-948b-e054c52e288e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1366 microversion: 2.1 time: 0.162673 Jul 07 15:37:14.716685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 284/565] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:14 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:15.733487 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fcc43bf0-4423-4642-9988-bf12faea988f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:15.734091 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fcc43bf0-4423-4642-9988-bf12faea988f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:15.737568 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:15.738256 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=14 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:15.743139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fcc43bf0-4423-4642-9988-bf12faea988f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:15.743606 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fcc43bf0-4423-4642-9988-bf12faea988f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:15.744449 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fcc43bf0-4423-4642-9988-bf12faea988f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:15.744876 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fcc43bf0-4423-4642-9988-bf12faea988f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:15.901807 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fcc43bf0-4423-4642-9988-bf12faea988f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:15.911055 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fcc43bf0-4423-4642-9988-bf12faea988f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1366 microversion: 2.1 time: 0.181914 Jul 07 15:37:15.911763 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 282/566] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:15 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:16.057608 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-4bdde742-241b-4e13-9f6c-7163c8f15875 req-5e06a772-fa5a-4f52-b673-3b6b965b8a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285e8356-8fad-43f7-ae21-52104c0b453f", "name": "network-vif-plugged", "status": "completed", "tag": "e7e5d408-0caa-4043-a605-2348d4827ea2"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:16.061316 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:16.067508 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-4bdde742-241b-4e13-9f6c-7163c8f15875 req-5e06a772-fa5a-4f52-b673-3b6b965b8a15 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:16.068012 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-4bdde742-241b-4e13-9f6c-7163c8f15875 req-5e06a772-fa5a-4f52-b673-3b6b965b8a15 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:16.080830 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-4bdde742-241b-4e13-9f6c-7163c8f15875 req-5e06a772-fa5a-4f52-b673-3b6b965b8a15 service nova] Creating event network-vif-plugged:e7e5d408-0caa-4043-a605-2348d4827ea2 for instance 285e8356-8fad-43f7-ae21-52104c0b453f on hv-cinder-84130 Jul 07 15:37:16.086045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-4bdde742-241b-4e13-9f6c-7163c8f15875 req-5e06a772-fa5a-4f52-b673-3b6b965b8a15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034990 Jul 07 15:37:16.086642 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 285/567] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:37:16.928427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-797a25a6-43a4-4a65-800a-dfc74e7232cc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:16.929035 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-797a25a6-43a4-4a65-800a-dfc74e7232cc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:16.935552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-797a25a6-43a4-4a65-800a-dfc74e7232cc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:16.935968 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-797a25a6-43a4-4a65-800a-dfc74e7232cc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:16.936769 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-797a25a6-43a4-4a65-800a-dfc74e7232cc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:16.937203 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-797a25a6-43a4-4a65-800a-dfc74e7232cc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:16.941329 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:17.070975 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-96388002", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-92263573", "security_groups": [{"name": "tempest-secgroup-smoke-1899091157"}], "block_device_mapping_v2": [{"uuid": "7535f083-cc46-4d16-a19d-5dc3c3bd44a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29820a51-47ed-4a8e-8170-71221aa2cdfe"}]}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:17.075068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-797a25a6-43a4-4a65-800a-dfc74e7232cc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:17.083085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-797a25a6-43a4-4a65-800a-dfc74e7232cc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1366 microversion: 2.1 time: 0.158441 Jul 07 15:37:17.083669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 283/568] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:16 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:17.185630 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.network.neutron [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] validate_networks() for [('29820a51-47ed-4a8e-8170-71221aa2cdfe', None, None, None, None, None)] {{(pid=124719) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:37:17.764701 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Flavor limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:37:17.765123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Image limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:37:17.765596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Flavor pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:37:17.766004 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Image pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:37:17.766413 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:37:17.775263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:17.775752 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:17.776548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:17.776980 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:17.794003 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Getting quotas for project b72dae7a2e644460b4c63da884023c82. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:37:17.798454 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Getting quotas for user 05e0f1ddeb224677b18cfc769dc45d47 and project b72dae7a2e644460b4c63da884023c82. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:37:17.853256 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Going to run 1 instances... {{(pid=124719) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:37:17.855398 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7535f083-cc46-4d16-a19d-5dc3c3bd44a8',volume_size=None,volume_type=None)] {{(pid=124719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:37:18.099062 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-030e3aaa-2f0d-4496-a5fe-c6498acfb5db tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:18.099762 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-030e3aaa-2f0d-4496-a5fe-c6498acfb5db tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:18.106202 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-030e3aaa-2f0d-4496-a5fe-c6498acfb5db tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:18.107053 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-030e3aaa-2f0d-4496-a5fe-c6498acfb5db tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:18.107848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-030e3aaa-2f0d-4496-a5fe-c6498acfb5db tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:18.108281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-030e3aaa-2f0d-4496-a5fe-c6498acfb5db tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:18.209099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9f2d94e6-c17b-4d55-961b-30047ad3696e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.142660 Jul 07 15:37:18.209789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 286/569] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:37:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 07 15:37:18.220420 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bafc2d3f-dfff-4c7a-b531-6a7b952b675a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:18.221059 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bafc2d3f-dfff-4c7a-b531-6a7b952b675a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:18.269770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-030e3aaa-2f0d-4496-a5fe-c6498acfb5db tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:18.279306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-030e3aaa-2f0d-4496-a5fe-c6498acfb5db tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1366 microversion: 2.1 time: 0.183896 Jul 07 15:37:18.280642 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 284/570] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:18 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:18.290409 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bafc2d3f-dfff-4c7a-b531-6a7b952b675a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:18.299291 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bafc2d3f-dfff-4c7a-b531-6a7b952b675a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1091 microversion: 2.1 time: 0.083222 Jul 07 15:37:18.299811 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 287/571] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:18 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1091 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:19.296878 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-133c943e-4dde-4283-9f62-ae2f60f689ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:19.297458 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-133c943e-4dde-4283-9f62-ae2f60f689ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:19.303927 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-133c943e-4dde-4283-9f62-ae2f60f689ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:19.304375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-133c943e-4dde-4283-9f62-ae2f60f689ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:19.305133 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-133c943e-4dde-4283-9f62-ae2f60f689ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:19.305566 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-133c943e-4dde-4283-9f62-ae2f60f689ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:19.316105 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f77c686b-bdeb-4046-996c-8fc646ab735f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:19.316716 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f77c686b-bdeb-4046-996c-8fc646ab735f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:19.323102 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f77c686b-bdeb-4046-996c-8fc646ab735f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:19.323553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f77c686b-bdeb-4046-996c-8fc646ab735f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:19.324342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f77c686b-bdeb-4046-996c-8fc646ab735f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:19.324769 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f77c686b-bdeb-4046-996c-8fc646ab735f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:19.400865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f77c686b-bdeb-4046-996c-8fc646ab735f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:19.403366 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:19.410045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f77c686b-bdeb-4046-996c-8fc646ab735f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1141 microversion: 2.1 time: 0.097709 Jul 07 15:37:19.419250 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 288/572] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:19 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1141 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:19.461697 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-133c943e-4dde-4283-9f62-ae2f60f689ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:19.469178 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-133c943e-4dde-4283-9f62-ae2f60f689ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1556 microversion: 2.1 time: 0.176331 Jul 07 15:37:19.470340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 285/573] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:19 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:19.486530 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-04098377-498b-4ab7-ac54-66699d098958 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:19.487009 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-04098377-498b-4ab7-ac54-66699d098958 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:19.493128 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-04098377-498b-4ab7-ac54-66699d098958 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:19.493564 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-04098377-498b-4ab7-ac54-66699d098958 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:19.494308 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-04098377-498b-4ab7-ac54-66699d098958 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:19.494732 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-04098377-498b-4ab7-ac54-66699d098958 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:19.575862 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-04098377-498b-4ab7-ac54-66699d098958 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093554 Jul 07 15:37:19.576473 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 289/574] 10.222.0.25 () {58 vars in 1274 bytes} [Thu Jul 7 15:37:19 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:20.426500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fad7c61a-ff58-4ea0-ae89-ce922d63c13a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:20.427128 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fad7c61a-ff58-4ea0-ae89-ce922d63c13a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:20.433681 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fad7c61a-ff58-4ea0-ae89-ce922d63c13a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:20.434134 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fad7c61a-ff58-4ea0-ae89-ce922d63c13a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:20.434902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fad7c61a-ff58-4ea0-ae89-ce922d63c13a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:20.435336 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fad7c61a-ff58-4ea0-ae89-ce922d63c13a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:20.522109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fad7c61a-ff58-4ea0-ae89-ce922d63c13a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:20.529796 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fad7c61a-ff58-4ea0-ae89-ce922d63c13a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1189 microversion: 2.1 time: 0.107430 Jul 07 15:37:20.530365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 286/575] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:20 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1189 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:20.768406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-01c2e44d-2287-4d69-a5e5-c065b7d89bca req-a229678e-f506-43fd-bbf2-1e4dee3dc9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285e8356-8fad-43f7-ae21-52104c0b453f", "tag": "e7e5d408-0caa-4043-a605-2348d4827ea2"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:20.777905 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-01c2e44d-2287-4d69-a5e5-c065b7d89bca req-a229678e-f506-43fd-bbf2-1e4dee3dc9ad service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:20.778352 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-01c2e44d-2287-4d69-a5e5-c065b7d89bca req-a229678e-f506-43fd-bbf2-1e4dee3dc9ad service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:20.801261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-01c2e44d-2287-4d69-a5e5-c065b7d89bca req-a229678e-f506-43fd-bbf2-1e4dee3dc9ad service nova] Creating event network-changed:e7e5d408-0caa-4043-a605-2348d4827ea2 for instance 285e8356-8fad-43f7-ae21-52104c0b453f on hv-cinder-84130 Jul 07 15:37:20.807183 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-01c2e44d-2287-4d69-a5e5-c065b7d89bca req-a229678e-f506-43fd-bbf2-1e4dee3dc9ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043357 Jul 07 15:37:20.809581 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 290/576] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:21.549578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e25abdc3-7ddb-4e47-b625-e1ec2680cd69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:21.550382 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e25abdc3-7ddb-4e47-b625-e1ec2680cd69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:21.559658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e25abdc3-7ddb-4e47-b625-e1ec2680cd69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:21.563030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e25abdc3-7ddb-4e47-b625-e1ec2680cd69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:21.563030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e25abdc3-7ddb-4e47-b625-e1ec2680cd69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:21.563030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e25abdc3-7ddb-4e47-b625-e1ec2680cd69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:21.749528 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e25abdc3-7ddb-4e47-b625-e1ec2680cd69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:21.764851 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e25abdc3-7ddb-4e47-b625-e1ec2680cd69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1275 microversion: 2.1 time: 0.221440 Jul 07 15:37:21.765495 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 287/577] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:21 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:22.783704 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-36d25eef-bca6-4847-b7e7-9c5401c5cc6a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:22.785424 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-36d25eef-bca6-4847-b7e7-9c5401c5cc6a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:22.792249 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-36d25eef-bca6-4847-b7e7-9c5401c5cc6a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:22.792795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-36d25eef-bca6-4847-b7e7-9c5401c5cc6a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:22.793650 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-36d25eef-bca6-4847-b7e7-9c5401c5cc6a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:22.794138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-36d25eef-bca6-4847-b7e7-9c5401c5cc6a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:22.829714 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-56ed5558-96a8-4ccc-982c-ca74ef96bf9d req-56cbfc9c-8210-42a7-83e4-7601ef250a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32392277-48d3-4a76-8afe-0df0a333ef33", "tag": "35593a8e-da9a-44a7-a403-00fa6a1c1cef"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:22.839955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-56ed5558-96a8-4ccc-982c-ca74ef96bf9d req-56cbfc9c-8210-42a7-83e4-7601ef250a59 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:22.840423 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-56ed5558-96a8-4ccc-982c-ca74ef96bf9d req-56cbfc9c-8210-42a7-83e4-7601ef250a59 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:22.852799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-56ed5558-96a8-4ccc-982c-ca74ef96bf9d req-56cbfc9c-8210-42a7-83e4-7601ef250a59 service nova] Creating event network-changed:35593a8e-da9a-44a7-a403-00fa6a1c1cef for instance 32392277-48d3-4a76-8afe-0df0a333ef33 on hv-cinder-84130 Jul 07 15:37:22.858110 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-56ed5558-96a8-4ccc-982c-ca74ef96bf9d req-56cbfc9c-8210-42a7-83e4-7601ef250a59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032918 Jul 07 15:37:22.859752 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 288/578] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:22.994480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-36d25eef-bca6-4847-b7e7-9c5401c5cc6a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:23.002783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-36d25eef-bca6-4847-b7e7-9c5401c5cc6a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.224167 Jul 07 15:37:23.003524 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 291/579] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:22 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:24.021249 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4664e01d-6aed-49ee-a700-4d2fd177db4a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:24.021948 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4664e01d-6aed-49ee-a700-4d2fd177db4a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:24.028121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4664e01d-6aed-49ee-a700-4d2fd177db4a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:24.028572 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4664e01d-6aed-49ee-a700-4d2fd177db4a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:24.029341 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4664e01d-6aed-49ee-a700-4d2fd177db4a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:24.029773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4664e01d-6aed-49ee-a700-4d2fd177db4a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:24.169657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-4664e01d-6aed-49ee-a700-4d2fd177db4a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:24.177764 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4664e01d-6aed-49ee-a700-4d2fd177db4a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.161216 Jul 07 15:37:24.193657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 289/580] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:24 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:25.194342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e9e91f49-b6db-4807-853e-28c7942f2c92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:25.194950 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e9e91f49-b6db-4807-853e-28c7942f2c92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:25.200939 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9e91f49-b6db-4807-853e-28c7942f2c92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:25.207412 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9e91f49-b6db-4807-853e-28c7942f2c92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:25.207412 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9e91f49-b6db-4807-853e-28c7942f2c92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:25.207412 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9e91f49-b6db-4807-853e-28c7942f2c92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:25.332868 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e9e91f49-b6db-4807-853e-28c7942f2c92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:25.340240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e9e91f49-b6db-4807-853e-28c7942f2c92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.149794 Jul 07 15:37:25.340798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 292/581] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:25 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:26.356846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ba932773-618e-4f55-afdb-02482eb902a7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:26.357443 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ba932773-618e-4f55-afdb-02482eb902a7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:26.363971 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ba932773-618e-4f55-afdb-02482eb902a7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:26.364413 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ba932773-618e-4f55-afdb-02482eb902a7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:26.365163 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ba932773-618e-4f55-afdb-02482eb902a7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:26.365590 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ba932773-618e-4f55-afdb-02482eb902a7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:26.499904 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ba932773-618e-4f55-afdb-02482eb902a7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:26.507820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ba932773-618e-4f55-afdb-02482eb902a7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.155040 Jul 07 15:37:26.508572 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 290/582] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:26 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:27.525097 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4e8370f4-3606-4c65-8513-b513392fbcc9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:27.525699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4e8370f4-3606-4c65-8513-b513392fbcc9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:27.531773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e8370f4-3606-4c65-8513-b513392fbcc9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:27.532835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e8370f4-3606-4c65-8513-b513392fbcc9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:27.533582 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e8370f4-3606-4c65-8513-b513392fbcc9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:27.534008 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e8370f4-3606-4c65-8513-b513392fbcc9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:27.659943 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4e8370f4-3606-4c65-8513-b513392fbcc9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:27.667207 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4e8370f4-3606-4c65-8513-b513392fbcc9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.145985 Jul 07 15:37:27.667790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 293/583] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:27 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:28.683877 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-728e6733-05bc-4d94-9025-0bdd26ed172a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:28.684402 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-728e6733-05bc-4d94-9025-0bdd26ed172a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:28.686843 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:28.691505 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-728e6733-05bc-4d94-9025-0bdd26ed172a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:28.691970 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-728e6733-05bc-4d94-9025-0bdd26ed172a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:28.692809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-728e6733-05bc-4d94-9025-0bdd26ed172a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:28.693130 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-728e6733-05bc-4d94-9025-0bdd26ed172a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:28.826785 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-728e6733-05bc-4d94-9025-0bdd26ed172a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:28.834278 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-728e6733-05bc-4d94-9025-0bdd26ed172a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.154308 Jul 07 15:37:28.834841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 291/584] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:28 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:29.850979 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1ca3ad28-fc3c-4533-94af-4a368e64adfa tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:29.851624 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1ca3ad28-fc3c-4533-94af-4a368e64adfa tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:29.853539 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:29.854214 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=8 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:29.859469 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1ca3ad28-fc3c-4533-94af-4a368e64adfa tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:29.860103 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1ca3ad28-fc3c-4533-94af-4a368e64adfa tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:29.860855 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1ca3ad28-fc3c-4533-94af-4a368e64adfa tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:29.861316 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1ca3ad28-fc3c-4533-94af-4a368e64adfa tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:29.996539 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1ca3ad28-fc3c-4533-94af-4a368e64adfa tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:30.004402 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1ca3ad28-fc3c-4533-94af-4a368e64adfa tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.157363 Jul 07 15:37:30.004980 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 294/585] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:29 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:31.022167 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fdbf50b4-d636-40cb-8ce2-8f13e7414f00 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:31.022775 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fdbf50b4-d636-40cb-8ce2-8f13e7414f00 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:31.029428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fdbf50b4-d636-40cb-8ce2-8f13e7414f00 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:31.029869 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fdbf50b4-d636-40cb-8ce2-8f13e7414f00 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:31.030628 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fdbf50b4-d636-40cb-8ce2-8f13e7414f00 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:31.031057 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fdbf50b4-d636-40cb-8ce2-8f13e7414f00 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:31.159494 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fdbf50b4-d636-40cb-8ce2-8f13e7414f00 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:31.166878 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fdbf50b4-d636-40cb-8ce2-8f13e7414f00 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.149309 Jul 07 15:37:31.167441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 292/586] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:31 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:32.184433 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cba9ea51-985d-4dee-b13b-89fcc96f4505 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:32.185126 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cba9ea51-985d-4dee-b13b-89fcc96f4505 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:32.187401 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-cae4d8bb-4f28-43fa-a44e-8bc6dd78645c req-55da67fb-8070-4455-9b07-7eb906a57b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32392277-48d3-4a76-8afe-0df0a333ef33", "name": "network-vif-plugged", "status": "completed", "tag": "35593a8e-da9a-44a7-a403-00fa6a1c1cef"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:32.191218 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cba9ea51-985d-4dee-b13b-89fcc96f4505 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:32.191777 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cba9ea51-985d-4dee-b13b-89fcc96f4505 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:32.192542 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cba9ea51-985d-4dee-b13b-89fcc96f4505 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:32.192963 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cba9ea51-985d-4dee-b13b-89fcc96f4505 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:32.197104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-cae4d8bb-4f28-43fa-a44e-8bc6dd78645c req-55da67fb-8070-4455-9b07-7eb906a57b42 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:32.203817 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-cae4d8bb-4f28-43fa-a44e-8bc6dd78645c req-55da67fb-8070-4455-9b07-7eb906a57b42 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:32.209244 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-cae4d8bb-4f28-43fa-a44e-8bc6dd78645c req-55da67fb-8070-4455-9b07-7eb906a57b42 service nova] Creating event network-vif-plugged:35593a8e-da9a-44a7-a403-00fa6a1c1cef for instance 32392277-48d3-4a76-8afe-0df0a333ef33 on hv-cinder-84130 Jul 07 15:37:32.214199 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-cae4d8bb-4f28-43fa-a44e-8bc6dd78645c req-55da67fb-8070-4455-9b07-7eb906a57b42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030667 Jul 07 15:37:32.215022 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 293/587] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:32.328527 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cba9ea51-985d-4dee-b13b-89fcc96f4505 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:32.336652 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cba9ea51-985d-4dee-b13b-89fcc96f4505 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.156303 Jul 07 15:37:32.337211 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 295/588] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:32 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:33.146264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7b6a3652-0bcf-4ecd-a080-1074593fdb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f60f9783-29f4-4af0-933a-ac6fd64f3b7d"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:33.147433 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7b6a3652-0bcf-4ecd-a080-1074593fdb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:33.153646 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b6a3652-0bcf-4ecd-a080-1074593fdb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:33.154090 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b6a3652-0bcf-4ecd-a080-1074593fdb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:33.154847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b6a3652-0bcf-4ecd-a080-1074593fdb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:33.155280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b6a3652-0bcf-4ecd-a080-1074593fdb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:33.352563 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2fc9c839-fd09-460d-8929-60f07eae83c5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:33.353167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2fc9c839-fd09-460d-8929-60f07eae83c5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:33.359402 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2fc9c839-fd09-460d-8929-60f07eae83c5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:33.359883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2fc9c839-fd09-460d-8929-60f07eae83c5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:33.360634 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2fc9c839-fd09-460d-8929-60f07eae83c5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:33.361653 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2fc9c839-fd09-460d-8929-60f07eae83c5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:33.491980 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2fc9c839-fd09-460d-8929-60f07eae83c5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:33.499492 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2fc9c839-fd09-460d-8929-60f07eae83c5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.150787 Jul 07 15:37:33.503928 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 296/589] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:33 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:33.874370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fd9ec211-5807-4e4a-a1ba-e6d794433693 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:33.874972 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fd9ec211-5807-4e4a-a1ba-e6d794433693 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:33.881014 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fd9ec211-5807-4e4a-a1ba-e6d794433693 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:33.881459 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fd9ec211-5807-4e4a-a1ba-e6d794433693 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:33.882212 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fd9ec211-5807-4e4a-a1ba-e6d794433693 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:33.882654 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fd9ec211-5807-4e4a-a1ba-e6d794433693 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:33.911257 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fd9ec211-5807-4e4a-a1ba-e6d794433693 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments/8df52655-d261-4b3d-9c99-4797df6a43e1" status: 200 len: 194 microversion: 2.20 time: 0.040924 Jul 07 15:37:33.911875 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 297/590] 10.222.0.25 () {60 vars in 1453 bytes} [Thu Jul 7 15:37:33 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments/8df52655-d261-4b3d-9c99-4797df6a43e1 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 15:37:33.974446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2b2c3dff-96fe-4898-85dd-7ba8ad762196 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:33.974969 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2b2c3dff-96fe-4898-85dd-7ba8ad762196 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:33.981063 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2b2c3dff-96fe-4898-85dd-7ba8ad762196 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:33.981510 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2b2c3dff-96fe-4898-85dd-7ba8ad762196 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:33.982528 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2b2c3dff-96fe-4898-85dd-7ba8ad762196 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:33.982963 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2b2c3dff-96fe-4898-85dd-7ba8ad762196 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:34.061785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-2b2c3dff-96fe-4898-85dd-7ba8ad762196 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lazy-loading 'services' on Instance uuid 2e85e6b3-ebad-441e-afcd-31692b27b782 {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:37:34.175895 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7b6a3652-0bcf-4ecd-a080-1074593fdb7d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033768 Jul 07 15:37:34.176539 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 294/591] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:37:33 2022] POST /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:34.290574 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2b2c3dff-96fe-4898-85dd-7ba8ad762196 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments/8df52655-d261-4b3d-9c99-4797df6a43e1" status: 202 len: 0 microversion: 2.20 time: 0.320372 Jul 07 15:37:34.291085 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 298/592] 10.222.0.25 () {60 vars in 1456 bytes} [Thu Jul 7 15:37:33 2022] DELETE /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments/8df52655-d261-4b3d-9c99-4797df6a43e1 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 07 15:37:34.300610 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9916570c-1a81-4b49-ad76-f590d320c31e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:34.301608 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9916570c-1a81-4b49-ad76-f590d320c31e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:34.308338 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9916570c-1a81-4b49-ad76-f590d320c31e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:34.308780 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9916570c-1a81-4b49-ad76-f590d320c31e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:34.312139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9916570c-1a81-4b49-ad76-f590d320c31e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:34.312139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9916570c-1a81-4b49-ad76-f590d320c31e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:34.339272 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9916570c-1a81-4b49-ad76-f590d320c31e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043509 Jul 07 15:37:34.339855 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 295/593] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:34 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:37:34.516919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-115a7849-6a81-446e-8b5d-1cc6b3a1a2b5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:34.517611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-115a7849-6a81-446e-8b5d-1cc6b3a1a2b5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:34.523862 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-115a7849-6a81-446e-8b5d-1cc6b3a1a2b5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:34.524308 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-115a7849-6a81-446e-8b5d-1cc6b3a1a2b5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:34.525062 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-115a7849-6a81-446e-8b5d-1cc6b3a1a2b5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:34.525493 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-115a7849-6a81-446e-8b5d-1cc6b3a1a2b5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:34.663712 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-115a7849-6a81-446e-8b5d-1cc6b3a1a2b5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:34.671921 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-115a7849-6a81-446e-8b5d-1cc6b3a1a2b5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1263 microversion: 2.1 time: 0.159077 Jul 07 15:37:34.672737 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 299/594] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:34 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:35.350357 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5ef7b453-8a76-4827-a602-8849ab588af0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:35.351397 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5ef7b453-8a76-4827-a602-8849ab588af0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:35.358109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ef7b453-8a76-4827-a602-8849ab588af0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:35.358555 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ef7b453-8a76-4827-a602-8849ab588af0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:35.359308 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ef7b453-8a76-4827-a602-8849ab588af0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:35.359773 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ef7b453-8a76-4827-a602-8849ab588af0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:35.388830 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5ef7b453-8a76-4827-a602-8849ab588af0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042366 Jul 07 15:37:35.389377 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 296/595] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:35 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:37:35.690168 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-50ffa3e5-26f0-4a05-af82-7e2aeb2137cd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:35.690803 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-50ffa3e5-26f0-4a05-af82-7e2aeb2137cd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:35.696850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-50ffa3e5-26f0-4a05-af82-7e2aeb2137cd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:35.697298 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-50ffa3e5-26f0-4a05-af82-7e2aeb2137cd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:35.698057 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-50ffa3e5-26f0-4a05-af82-7e2aeb2137cd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:35.698491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-50ffa3e5-26f0-4a05-af82-7e2aeb2137cd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:35.825013 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-50ffa3e5-26f0-4a05-af82-7e2aeb2137cd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:35.832442 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-50ffa3e5-26f0-4a05-af82-7e2aeb2137cd tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1449 microversion: 2.1 time: 0.146696 Jul 07 15:37:35.833002 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 300/596] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:35 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:35.848404 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-06ff46f0-ecb3-4411-9b7a-a9cf1f40ea9d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:35.849014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-06ff46f0-ecb3-4411-9b7a-a9cf1f40ea9d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:35.854945 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-06ff46f0-ecb3-4411-9b7a-a9cf1f40ea9d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:35.855390 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-06ff46f0-ecb3-4411-9b7a-a9cf1f40ea9d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:35.856176 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-06ff46f0-ecb3-4411-9b7a-a9cf1f40ea9d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:35.856615 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-06ff46f0-ecb3-4411-9b7a-a9cf1f40ea9d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:35.989231 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-06ff46f0-ecb3-4411-9b7a-a9cf1f40ea9d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:35.996759 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-06ff46f0-ecb3-4411-9b7a-a9cf1f40ea9d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1449 microversion: 2.1 time: 0.152179 Jul 07 15:37:35.997322 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 297/597] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:35 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:36.401753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-57190cfb-4c2c-4045-9b53-628729cb89f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:36.402683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-57190cfb-4c2c-4045-9b53-628729cb89f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:36.404715 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:36.410128 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57190cfb-4c2c-4045-9b53-628729cb89f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:36.415724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57190cfb-4c2c-4045-9b53-628729cb89f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:36.415724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57190cfb-4c2c-4045-9b53-628729cb89f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:36.415724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57190cfb-4c2c-4045-9b53-628729cb89f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:36.445759 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-57190cfb-4c2c-4045-9b53-628729cb89f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047676 Jul 07 15:37:36.446835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 301/598] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:36 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 15:37:37.460662 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3771822e-6618-4dea-ac8b-888dd5039814 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:37.461500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3771822e-6618-4dea-ac8b-888dd5039814 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:37.468126 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3771822e-6618-4dea-ac8b-888dd5039814 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:37.468563 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3771822e-6618-4dea-ac8b-888dd5039814 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:37.469307 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3771822e-6618-4dea-ac8b-888dd5039814 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:37.473579 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3771822e-6618-4dea-ac8b-888dd5039814 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:37.498793 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3771822e-6618-4dea-ac8b-888dd5039814 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042259 Jul 07 15:37:37.500281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 298/599] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:37 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:37:38.093112 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-c1a645df-3f13-472e-96a2-fbede7f9a240 req-9a7ed7fc-8f3c-465d-bd06-927da581e94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32392277-48d3-4a76-8afe-0df0a333ef33", "tag": "35593a8e-da9a-44a7-a403-00fa6a1c1cef"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:38.102096 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-c1a645df-3f13-472e-96a2-fbede7f9a240 req-9a7ed7fc-8f3c-465d-bd06-927da581e94c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:38.102546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-c1a645df-3f13-472e-96a2-fbede7f9a240 req-9a7ed7fc-8f3c-465d-bd06-927da581e94c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:38.113913 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-c1a645df-3f13-472e-96a2-fbede7f9a240 req-9a7ed7fc-8f3c-465d-bd06-927da581e94c service nova] Creating event network-changed:35593a8e-da9a-44a7-a403-00fa6a1c1cef for instance 32392277-48d3-4a76-8afe-0df0a333ef33 on hv-cinder-84130 Jul 07 15:37:38.118936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-c1a645df-3f13-472e-96a2-fbede7f9a240 req-9a7ed7fc-8f3c-465d-bd06-927da581e94c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029449 Jul 07 15:37:38.119521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 302/600] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:38.510737 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f4a1dfc8-0754-49cc-997c-5bda5023f5eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:38.512502 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f4a1dfc8-0754-49cc-997c-5bda5023f5eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:38.520006 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4a1dfc8-0754-49cc-997c-5bda5023f5eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:38.520724 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4a1dfc8-0754-49cc-997c-5bda5023f5eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:38.521805 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4a1dfc8-0754-49cc-997c-5bda5023f5eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:38.522419 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4a1dfc8-0754-49cc-997c-5bda5023f5eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:38.553362 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:38.556282 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f4a1dfc8-0754-49cc-997c-5bda5023f5eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049572 Jul 07 15:37:38.557159 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 299/601] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:38 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:37:39.569261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0d089f20-9b40-40a8-b84c-aadac0c14a37 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:39.570252 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0d089f20-9b40-40a8-b84c-aadac0c14a37 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:39.576482 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d089f20-9b40-40a8-b84c-aadac0c14a37 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:39.576923 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d089f20-9b40-40a8-b84c-aadac0c14a37 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:39.577669 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d089f20-9b40-40a8-b84c-aadac0c14a37 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:39.578096 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d089f20-9b40-40a8-b84c-aadac0c14a37 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:39.605508 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0d089f20-9b40-40a8-b84c-aadac0c14a37 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041136 Jul 07 15:37:39.606043 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 303/602] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:39 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:37:40.617664 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b9ca2840-3c64-4c3f-bfde-3757daee4a7e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:40.618850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b9ca2840-3c64-4c3f-bfde-3757daee4a7e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:40.626174 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b9ca2840-3c64-4c3f-bfde-3757daee4a7e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:40.626985 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b9ca2840-3c64-4c3f-bfde-3757daee4a7e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:40.627501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b9ca2840-3c64-4c3f-bfde-3757daee4a7e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:40.627954 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b9ca2840-3c64-4c3f-bfde-3757daee4a7e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:40.655857 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b9ca2840-3c64-4c3f-bfde-3757daee4a7e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042209 Jul 07 15:37:40.658351 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 300/603] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:40 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:37:41.667502 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-65205809-726f-40ad-a11d-2c663fb45dee tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:41.668464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-65205809-726f-40ad-a11d-2c663fb45dee tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:41.675149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-65205809-726f-40ad-a11d-2c663fb45dee tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:41.675611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-65205809-726f-40ad-a11d-2c663fb45dee tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:41.676365 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-65205809-726f-40ad-a11d-2c663fb45dee tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:41.676793 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-65205809-726f-40ad-a11d-2c663fb45dee tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:41.706716 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-65205809-726f-40ad-a11d-2c663fb45dee tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043141 Jul 07 15:37:41.707280 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 304/604] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:41 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:37:42.716244 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5ac9b23e-5d13-4e44-909a-448a19094845 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:42.717109 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5ac9b23e-5d13-4e44-909a-448a19094845 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:42.718239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2d8cea81-fcd6-4a48-8891-d16c85975042 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:42.719170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2d8cea81-fcd6-4a48-8891-d16c85975042 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:42.723922 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ac9b23e-5d13-4e44-909a-448a19094845 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:42.724361 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ac9b23e-5d13-4e44-909a-448a19094845 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:42.725115 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ac9b23e-5d13-4e44-909a-448a19094845 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:42.725266 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d8cea81-fcd6-4a48-8891-d16c85975042 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:42.725537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5ac9b23e-5d13-4e44-909a-448a19094845 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:42.725709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d8cea81-fcd6-4a48-8891-d16c85975042 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:42.726463 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d8cea81-fcd6-4a48-8891-d16c85975042 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:42.726890 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d8cea81-fcd6-4a48-8891-d16c85975042 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:42.748473 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-5ac9b23e-5d13-4e44-909a-448a19094845 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lazy-loading 'flavor' on Instance uuid 05028730-a81d-4edf-a4e2-96d672547be4 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:37:42.757391 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2d8cea81-fcd6-4a48-8891-d16c85975042 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043041 Jul 07 15:37:42.758207 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 305/605] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:42 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 15:37:43.048089 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5ac9b23e-5d13-4e44-909a-448a19094845 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/action" status: 200 len: 32 microversion: 2.1 time: 0.336139 Jul 07 15:37:43.048798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 301/606] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:37:42 2022] POST /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/action => generated 32 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:37:43.057731 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c433bb0b-5218-4319-aa82-bc071ddc50c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:43.058332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c433bb0b-5218-4319-aa82-bc071ddc50c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:43.065079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c433bb0b-5218-4319-aa82-bc071ddc50c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:43.065516 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c433bb0b-5218-4319-aa82-bc071ddc50c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:43.066263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c433bb0b-5218-4319-aa82-bc071ddc50c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:43.066687 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c433bb0b-5218-4319-aa82-bc071ddc50c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:43.082674 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:37:43.234984 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c433bb0b-5218-4319-aa82-bc071ddc50c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:43.243493 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c433bb0b-5218-4319-aa82-bc071ddc50c3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.189528 Jul 07 15:37:43.244082 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 306/607] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:43 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:43.770458 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-44358dcd-8710-4b45-8034-45e7585ceaa9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:43.771374 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-44358dcd-8710-4b45-8034-45e7585ceaa9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:43.777669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44358dcd-8710-4b45-8034-45e7585ceaa9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:43.778117 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44358dcd-8710-4b45-8034-45e7585ceaa9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:43.778881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44358dcd-8710-4b45-8034-45e7585ceaa9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:43.779317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44358dcd-8710-4b45-8034-45e7585ceaa9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:43.808505 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-44358dcd-8710-4b45-8034-45e7585ceaa9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042982 Jul 07 15:37:43.809054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 302/608] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:37:43 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:43.867944 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-22e6edc9-6c6a-401e-9d55-14a208e33dcd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:43.868444 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-22e6edc9-6c6a-401e-9d55-14a208e33dcd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:43.874446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-22e6edc9-6c6a-401e-9d55-14a208e33dcd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:43.874893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-22e6edc9-6c6a-401e-9d55-14a208e33dcd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:43.875702 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-22e6edc9-6c6a-401e-9d55-14a208e33dcd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:43.876132 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-22e6edc9-6c6a-401e-9d55-14a208e33dcd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:43.899876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-22e6edc9-6c6a-401e-9d55-14a208e33dcd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:37:44.140730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-22e6edc9-6c6a-401e-9d55-14a208e33dcd tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 204 len: 0 microversion: 2.20 time: 0.276287 Jul 07 15:37:44.141326 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 307/609] 10.222.0.25 () {60 vars in 1279 bytes} [Thu Jul 7 15:37:43 2022] DELETE /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 15:37:44.149619 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:44.150272 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:44.156384 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:44.156832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:44.157591 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:44.158338 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:44.261445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d9f1c09a-89e8-4cb7-930e-f56102d379e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:44.262136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d9f1c09a-89e8-4cb7-930e-f56102d379e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:44.268349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d9f1c09a-89e8-4cb7-930e-f56102d379e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:44.268799 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d9f1c09a-89e8-4cb7-930e-f56102d379e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:44.269557 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d9f1c09a-89e8-4cb7-930e-f56102d379e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:44.269985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d9f1c09a-89e8-4cb7-930e-f56102d379e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:44.288213 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:44.296214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:44.297726 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:44.299610 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b77b8c29-68f3-469c-b107-f7b09b824690 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.153893 Jul 07 15:37:44.300176 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 303/610] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:44 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:37:44.410711 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d9f1c09a-89e8-4cb7-930e-f56102d379e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:44.413001 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d9f1c09a-89e8-4cb7-930e-f56102d379e7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.156045 Jul 07 15:37:44.413555 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 308/611] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:44 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:45.318050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:45.318582 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:45.325055 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:45.325491 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:45.326269 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:45.326691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:45.430503 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-73f03c04-68a2-44fe-b7c2-a8daa681dc22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:45.431105 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-73f03c04-68a2-44fe-b7c2-a8daa681dc22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:45.437087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-73f03c04-68a2-44fe-b7c2-a8daa681dc22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:45.437529 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-73f03c04-68a2-44fe-b7c2-a8daa681dc22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:45.438277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-73f03c04-68a2-44fe-b7c2-a8daa681dc22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:45.438703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-73f03c04-68a2-44fe-b7c2-a8daa681dc22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:45.463153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:45.472200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:45.473726 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:45.475029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ef6aa716-0e8b-4927-88d8-126c604eb0ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.161067 Jul 07 15:37:45.475616 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 304/612] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:45 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:37:45.564907 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-73f03c04-68a2-44fe-b7c2-a8daa681dc22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:45.572770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-73f03c04-68a2-44fe-b7c2-a8daa681dc22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.146029 Jul 07 15:37:45.573266 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 309/613] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:45 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:46.493847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:46.494457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:46.501304 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:46.502376 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:46.503158 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:46.503611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:46.590320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f0e1ab90-f62b-4d0b-8b6c-068ec5d47fa0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:46.591117 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f0e1ab90-f62b-4d0b-8b6c-068ec5d47fa0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:46.598080 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f0e1ab90-f62b-4d0b-8b6c-068ec5d47fa0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:46.598609 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f0e1ab90-f62b-4d0b-8b6c-068ec5d47fa0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:46.599447 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f0e1ab90-f62b-4d0b-8b6c-068ec5d47fa0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:46.599973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f0e1ab90-f62b-4d0b-8b6c-068ec5d47fa0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:46.924157 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:46.931817 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f0e1ab90-f62b-4d0b-8b6c-068ec5d47fa0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:46.932975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:46.934575 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:46.935796 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fb9801b9-acf6-4ec1-b566-e996ceaf86f3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1723 microversion: 2.20 time: 0.445987 Jul 07 15:37:46.938966 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 305/614] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:46 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1723 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:37:46.940066 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f0e1ab90-f62b-4d0b-8b6c-068ec5d47fa0 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.353622 Jul 07 15:37:46.940631 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 310/615] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:46 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:47.384511 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-7de8479a-68aa-444c-8ae8-aea6f2da43d4 req-40197502-025e-4e35-9ff5-c9406ce2f4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e85e6b3-ebad-441e-afcd-31692b27b782", "name": "network-vif-deleted", "tag": "8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:47.393308 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-7de8479a-68aa-444c-8ae8-aea6f2da43d4 req-40197502-025e-4e35-9ff5-c9406ce2f4c0 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:47.393954 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-7de8479a-68aa-444c-8ae8-aea6f2da43d4 req-40197502-025e-4e35-9ff5-c9406ce2f4c0 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:47.404708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-7de8479a-68aa-444c-8ae8-aea6f2da43d4 req-40197502-025e-4e35-9ff5-c9406ce2f4c0 service nova] Creating event network-vif-deleted:8fdf4d0b-ba0f-4678-90b0-fd76e9c8e54a for instance 2e85e6b3-ebad-441e-afcd-31692b27b782 on hv-cinder-84130 Jul 07 15:37:47.409422 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-7de8479a-68aa-444c-8ae8-aea6f2da43d4 req-40197502-025e-4e35-9ff5-c9406ce2f4c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028492 Jul 07 15:37:47.410004 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 306/616] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:47.954524 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:47.956186 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:47.962726 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-53416860-c99b-4e9e-85d1-275d57c7ca24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:47.963227 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:47.963712 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-53416860-c99b-4e9e-85d1-275d57c7ca24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:47.964180 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:47.965192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:47.965985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:47.970939 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-53416860-c99b-4e9e-85d1-275d57c7ca24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:47.971419 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-53416860-c99b-4e9e-85d1-275d57c7ca24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:47.972215 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-53416860-c99b-4e9e-85d1-275d57c7ca24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:47.972643 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-53416860-c99b-4e9e-85d1-275d57c7ca24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:47.998796 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:47.999248 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:47.999731 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lazy-loading 'fault' on Instance uuid 2e85e6b3-ebad-441e-afcd-31692b27b782 {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:37:48.072812 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:48.084332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:48.086187 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:48.087348 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-94ebf354-4631-4046-81ec-b05cd385c0f1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 200 len: 1371 microversion: 2.20 time: 0.136887 Jul 07 15:37:48.088513 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 311/617] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:47 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:37:48.146485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-53416860-c99b-4e9e-85d1-275d57c7ca24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:48.154513 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-53416860-c99b-4e9e-85d1-275d57c7ca24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.197309 Jul 07 15:37:48.155086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 307/618] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:47 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:49.106325 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:49.106944 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:49.113482 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:49.113919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:49.114706 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:49.115249 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:49.128897 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] HTTP exception thrown: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Request method failure captured: Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 HTTP/1.1 Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy5VA9xzUkp0A_TjHipvEzrnzhrmBltWt_8c9jvMfhZlt4rWxAxkq0LZeY7r64b8EuHHf7bQXWeVuRBDubhUVSHTSk7d5tQPA6o6ByIIb-rkFWc2juaRxIURJaUezXTAxc8zhv83qGiZ5yflcSusr3KdNWepH651GVW2DrhV4qpkj0 Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:37:49.130320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2e4afda121042939745304ce6f76a8b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 2033ad40d45747aa8294e4feb5a6cfe0 Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:37:49.132109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '2e85e6b3-ebad-441e-afcd-31692b27b782'} Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:37:49.133159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:37:49.134417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:37:49.135771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Returning 404 to user: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:37:49.135771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2c89b267-03e9-4745-94a8-18b48428c589 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 404 len: 111 microversion: 2.20 time: 0.029382 Jul 07 15:37:49.135771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 312/619] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:49 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 15:37:49.140794 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-287019be-32bf-4119-aae7-860950b47da3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '.version_select at 0x7f5248e6c820>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:49.172713 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5c0e44e7-774a-4f36-a8bc-5d91f1cdaccb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:49.173850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5c0e44e7-774a-4f36-a8bc-5d91f1cdaccb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:49.179950 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c0e44e7-774a-4f36-a8bc-5d91f1cdaccb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:49.180420 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c0e44e7-774a-4f36-a8bc-5d91f1cdaccb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:49.181165 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c0e44e7-774a-4f36-a8bc-5d91f1cdaccb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:49.181589 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c0e44e7-774a-4f36-a8bc-5d91f1cdaccb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:49.227497 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-287019be-32bf-4119-aae7-860950b47da3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046237054" status: 204 len: 0 microversion: 2.20 time: 0.090393 Jul 07 15:37:49.228288 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 308/620] 10.222.0.25 () {60 vars in 1261 bytes} [Thu Jul 7 15:37:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046237054 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 15:37:49.310394 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5c0e44e7-774a-4f36-a8bc-5d91f1cdaccb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:49.318951 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5c0e44e7-774a-4f36-a8bc-5d91f1cdaccb tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.150109 Jul 07 15:37:49.319526 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 313/621] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:49 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:49.937051 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-10786296-7b82-4b65-9d92-dc832c31791e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'create', calling method: .version_select at 0x7f5248ece9d0>, body: {"keypair": {"name": "tempest-keypair-107894480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhuqDNAj/s+R1EuwC6YHGgkw0tNxneto4uAUaM0XTv0kaXtyIjmk2DbqQXYud0TfINA3/U9SOwygJF9tPBPycThL4hUN3KbxGHz0bvG4qTT8nVM6vFmBlBrig+baPohYw=="}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:49.951270 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-10786296-7b82-4b65-9d92-dc832c31791e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Getting quotas for project d2e4afda121042939745304ce6f76a8b. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:37:49.955776 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-10786296-7b82-4b65-9d92-dc832c31791e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Getting quotas for user 2033ad40d45747aa8294e4feb5a6cfe0 and project d2e4afda121042939745304ce6f76a8b. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:37:50.075466 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-10786296-7b82-4b65-9d92-dc832c31791e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.142269 Jul 07 15:37:50.076124 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 309/622] 10.222.0.25 () {62 vars in 1199 bytes} [Thu Jul 7 15:37:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 07 15:37:50.335207 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-863e30e1-e1c5-429a-97f6-aaf2e0a2cb72 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:50.335849 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-863e30e1-e1c5-429a-97f6-aaf2e0a2cb72 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:50.342750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-863e30e1-e1c5-429a-97f6-aaf2e0a2cb72 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:50.342750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-863e30e1-e1c5-429a-97f6-aaf2e0a2cb72 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:50.343329 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-863e30e1-e1c5-429a-97f6-aaf2e0a2cb72 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:50.343828 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-863e30e1-e1c5-429a-97f6-aaf2e0a2cb72 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:50.479745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-863e30e1-e1c5-429a-97f6-aaf2e0a2cb72 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:50.488598 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-863e30e1-e1c5-429a-97f6-aaf2e0a2cb72 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.157320 Jul 07 15:37:50.489170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 314/623] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:50 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:51.505457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3a8b0d6d-a47e-4abe-ad43-11ac964953d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:51.506009 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3a8b0d6d-a47e-4abe-ad43-11ac964953d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:51.512030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a8b0d6d-a47e-4abe-ad43-11ac964953d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:51.512471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a8b0d6d-a47e-4abe-ad43-11ac964953d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:51.513235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a8b0d6d-a47e-4abe-ad43-11ac964953d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:51.513664 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a8b0d6d-a47e-4abe-ad43-11ac964953d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:51.645304 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3a8b0d6d-a47e-4abe-ad43-11ac964953d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:51.651980 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3a8b0d6d-a47e-4abe-ad43-11ac964953d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.150839 Jul 07 15:37:51.652564 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 310/624] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:51 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:52.273434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1102217829", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e12eafaa-cd14-4167-a6ef-a2ef64a70cc9"}], "security_groups": [{"name": "tempest-securitygroup--75560086"}], "key_name": "tempest-keypair-107894480", "user_data": "}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:52.370795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.network.neutron [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] validate_networks() for [('e12eafaa-cd14-4167-a6ef-a2ef64a70cc9', None, None, None, None, None)] {{(pid=124719) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:37:52.669552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fca06f5d-6468-40af-bb20-16765990f6c2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:52.670163 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fca06f5d-6468-40af-bb20-16765990f6c2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:52.677056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fca06f5d-6468-40af-bb20-16765990f6c2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:52.677499 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fca06f5d-6468-40af-bb20-16765990f6c2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:52.678258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fca06f5d-6468-40af-bb20-16765990f6c2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:52.678691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fca06f5d-6468-40af-bb20-16765990f6c2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:52.774715 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Flavor limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:37:52.775130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Image limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:37:52.775614 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Flavor pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:37:52.776022 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Image pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:37:52.776423 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:37:52.785987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:52.786431 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:52.787253 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:52.787703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:52.806970 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Getting quotas for project d2e4afda121042939745304ce6f76a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:37:52.811175 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Getting quotas for user 2033ad40d45747aa8294e4feb5a6cfe0 and project d2e4afda121042939745304ce6f76a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:37:52.822593 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Going to run 1 instances... {{(pid=124719) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:37:52.824883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:37:52.833546 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fca06f5d-6468-40af-bb20-16765990f6c2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:52.840550 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fca06f5d-6468-40af-bb20-16765990f6c2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.174743 Jul 07 15:37:52.841266 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 311/625] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:52 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:52.948188 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4aebfc13-250e-437f-81ea-4ea27c7ee17b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.678964 Jul 07 15:37:52.948818 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 315/626] 10.222.0.25 () {62 vars in 1187 bytes} [Thu Jul 7 15:37:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 07 15:37:52.959545 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-782463f6-c2a6-44a8-85c2-1077f8cd42ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:52.963551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-782463f6-c2a6-44a8-85c2-1077f8cd42ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:53.015139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-782463f6-c2a6-44a8-85c2-1077f8cd42ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:53.023993 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-782463f6-c2a6-44a8-85c2-1077f8cd42ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:53.025679 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-782463f6-c2a6-44a8-85c2-1077f8cd42ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:53.026739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-782463f6-c2a6-44a8-85c2-1077f8cd42ab tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1281 microversion: 2.20 time: 0.071101 Jul 07 15:37:53.027309 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 312/627] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:52 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:37:53.858600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6d96535e-a697-4d3e-a67e-33decb05ff13 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:53.859215 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6d96535e-a697-4d3e-a67e-33decb05ff13 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:53.865330 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d96535e-a697-4d3e-a67e-33decb05ff13 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:53.865775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d96535e-a697-4d3e-a67e-33decb05ff13 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:53.866531 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d96535e-a697-4d3e-a67e-33decb05ff13 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:53.866966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6d96535e-a697-4d3e-a67e-33decb05ff13 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:53.997783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6d96535e-a697-4d3e-a67e-33decb05ff13 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:54.005861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6d96535e-a697-4d3e-a67e-33decb05ff13 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.151505 Jul 07 15:37:54.006426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 316/628] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:53 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:54.044280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:54.044882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:54.051866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:54.052309 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:54.053058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:54.053485 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:54.114979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:54.123314 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:54.124980 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:54.126073 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fa4c0523-b506-406d-838e-368081929217 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1285 microversion: 2.20 time: 0.085647 Jul 07 15:37:54.127174 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 313/629] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:54 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:37:55.022231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b0b9f89e-bac7-4ec6-91f4-e9da3b27436a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:55.022844 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b0b9f89e-bac7-4ec6-91f4-e9da3b27436a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:55.029053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b0b9f89e-bac7-4ec6-91f4-e9da3b27436a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:55.029498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b0b9f89e-bac7-4ec6-91f4-e9da3b27436a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:55.030262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b0b9f89e-bac7-4ec6-91f4-e9da3b27436a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:55.030698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b0b9f89e-bac7-4ec6-91f4-e9da3b27436a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:55.144377 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:55.145215 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:55.151795 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:55.152354 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:55.153169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:55.153677 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:55.229326 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:55.237599 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b0b9f89e-bac7-4ec6-91f4-e9da3b27436a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:55.237910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:55.239382 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:55.240489 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-050aaf07-0e29-4cae-a393-8ac6eaa1c991 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1339 microversion: 2.20 time: 0.100820 Jul 07 15:37:55.241093 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 314/630] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:55 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:37:55.242070 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b0b9f89e-bac7-4ec6-91f4-e9da3b27436a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.223692 Jul 07 15:37:55.242625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 317/631] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:55 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:37:56.258669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:56.259266 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:56.259593 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0c8bdbfc-1f68-4b43-8be7-79593faece12 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:56.260305 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0c8bdbfc-1f68-4b43-8be7-79593faece12 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:56.266733 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:56.267299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:56.268013 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:56.268460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:56.268766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0c8bdbfc-1f68-4b43-8be7-79593faece12 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:56.269211 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0c8bdbfc-1f68-4b43-8be7-79593faece12 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:56.269967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0c8bdbfc-1f68-4b43-8be7-79593faece12 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:56.276790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0c8bdbfc-1f68-4b43-8be7-79593faece12 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:56.541667 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:56.544149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0c8bdbfc-1f68-4b43-8be7-79593faece12 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:56.549799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:56.551250 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:56.552565 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c5e1c25b-df27-4a3c-942d-24ae843396a6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1405 microversion: 2.20 time: 0.297953 Jul 07 15:37:56.553039 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0c8bdbfc-1f68-4b43-8be7-79593faece12 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.298076 Jul 07 15:37:56.553676 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 318/632] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:56 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:56.563004 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 315/633] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:56 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:37:56.720572 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-ec7358dc-a1a0-4b17-af2c-6e6f2844770f req-bc2d1264-1550-482b-b9be-a584bbbfa796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cfd6f9-be72-41c0-8887-1425b3f5565c", "tag": "cd19f05f-6752-480d-a56b-5d74f03e8e3a"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:37:56.730306 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-ec7358dc-a1a0-4b17-af2c-6e6f2844770f req-bc2d1264-1550-482b-b9be-a584bbbfa796 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:56.733514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-ec7358dc-a1a0-4b17-af2c-6e6f2844770f req-bc2d1264-1550-482b-b9be-a584bbbfa796 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:56.748170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-ec7358dc-a1a0-4b17-af2c-6e6f2844770f req-bc2d1264-1550-482b-b9be-a584bbbfa796 service nova] Creating event network-changed:cd19f05f-6752-480d-a56b-5d74f03e8e3a for instance d8cfd6f9-be72-41c0-8887-1425b3f5565c on hv-cinder-84130 Jul 07 15:37:56.753795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-ec7358dc-a1a0-4b17-af2c-6e6f2844770f req-bc2d1264-1550-482b-b9be-a584bbbfa796 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037323 Jul 07 15:37:56.754695 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 319/634] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:37:57.570794 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e07e5386-2c98-4ab7-a466-91c015e386bc tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:57.571325 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:57.571728 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e07e5386-2c98-4ab7-a466-91c015e386bc tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:57.572827 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:57.579098 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e07e5386-2c98-4ab7-a466-91c015e386bc tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:57.579309 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:57.579716 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e07e5386-2c98-4ab7-a466-91c015e386bc tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:57.579835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:57.580614 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:57.580728 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e07e5386-2c98-4ab7-a466-91c015e386bc tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:57.581161 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:57.581268 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e07e5386-2c98-4ab7-a466-91c015e386bc tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:57.814779 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:57.818273 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e07e5386-2c98-4ab7-a466-91c015e386bc tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:57.823150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:57.824697 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:57.825812 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cf5c06ee-7f4b-4516-9edb-99b695feb4eb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1405 microversion: 2.20 time: 0.258717 Jul 07 15:37:57.826370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 320/635] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:57 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:37:57.826538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e07e5386-2c98-4ab7-a466-91c015e386bc tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.259674 Jul 07 15:37:57.827096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 316/636] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:57 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:37:58.843463 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a0a67b4e-91f8-4d2a-8201-3d46eab3e6d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:58.844032 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:37:58.844388 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a0a67b4e-91f8-4d2a-8201-3d46eab3e6d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:58.844471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:37:58.850139 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a0a67b4e-91f8-4d2a-8201-3d46eab3e6d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:58.850574 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a0a67b4e-91f8-4d2a-8201-3d46eab3e6d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:58.850813 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:58.851253 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:58.851359 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a0a67b4e-91f8-4d2a-8201-3d46eab3e6d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:58.851775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a0a67b4e-91f8-4d2a-8201-3d46eab3e6d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:58.852033 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:37:58.852466 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:37:59.039668 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:59.048915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:59.050490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:59.051611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1e077453-f4e7-4ecc-bd7d-e9d4f77043ed tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1405 microversion: 2.20 time: 0.211687 Jul 07 15:37:59.052166 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 317/637] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:37:58 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:37:59.077169 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a0a67b4e-91f8-4d2a-8201-3d46eab3e6d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:37:59.085087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a0a67b4e-91f8-4d2a-8201-3d46eab3e6d4 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.245486 Jul 07 15:37:59.085644 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 321/638] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:37:58 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:00.069554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:00.070158 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:00.089871 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:00.090312 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:00.091072 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:00.091502 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:00.096315 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:00.102625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-70b73b52-303e-48a6-9c12-c0d664eebb24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:00.103233 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-70b73b52-303e-48a6-9c12-c0d664eebb24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:00.113940 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-70b73b52-303e-48a6-9c12-c0d664eebb24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:00.119332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-70b73b52-303e-48a6-9c12-c0d664eebb24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:00.119332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-70b73b52-303e-48a6-9c12-c0d664eebb24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:00.119332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-70b73b52-303e-48a6-9c12-c0d664eebb24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:00.347762 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:00.355728 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:00.357221 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:00.358577 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3fe23a93-a0f9-4883-acd5-5cf1d7fe8e6e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1405 microversion: 2.20 time: 0.293025 Jul 07 15:38:00.359130 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 318/639] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:00 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1405 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:00.388452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-70b73b52-303e-48a6-9c12-c0d664eebb24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:00.397234 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-70b73b52-303e-48a6-9c12-c0d664eebb24 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.298860 Jul 07 15:38:00.397853 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 322/640] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:00 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:01.376943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:01.377544 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:01.379817 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:01.384595 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:01.385036 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:01.385787 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:01.386212 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:01.414192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-afa0e92e-6ecc-450c-b53c-5f684ba63528 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:01.414789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-afa0e92e-6ecc-450c-b53c-5f684ba63528 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:01.420840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afa0e92e-6ecc-450c-b53c-5f684ba63528 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:01.421282 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afa0e92e-6ecc-450c-b53c-5f684ba63528 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:01.422207 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afa0e92e-6ecc-450c-b53c-5f684ba63528 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:01.422805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afa0e92e-6ecc-450c-b53c-5f684ba63528 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:01.425877 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:01.620927 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-afa0e92e-6ecc-450c-b53c-5f684ba63528 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:01.627502 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:01.629269 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-afa0e92e-6ecc-450c-b53c-5f684ba63528 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1735 microversion: 2.1 time: 0.218792 Jul 07 15:38:01.629855 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 323/641] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:01 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:01.635322 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:01.636851 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:01.637940 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f9f8b4b1-2396-4549-8b22-636a456a8b6b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1405 microversion: 2.20 time: 0.265451 Jul 07 15:38:01.638481 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 319/642] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:01 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:02.353786 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-0ecf8910-7867-4a6f-b477-0b49dfe0fb08 req-bd244a3a-4f29-468c-b52e-c6e588184344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cfd6f9-be72-41c0-8887-1425b3f5565c", "name": "network-vif-plugged", "status": "completed", "tag": "cd19f05f-6752-480d-a56b-5d74f03e8e3a"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:02.362194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-0ecf8910-7867-4a6f-b477-0b49dfe0fb08 req-bd244a3a-4f29-468c-b52e-c6e588184344 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:02.362633 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-0ecf8910-7867-4a6f-b477-0b49dfe0fb08 req-bd244a3a-4f29-468c-b52e-c6e588184344 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:02.373346 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-0ecf8910-7867-4a6f-b477-0b49dfe0fb08 req-bd244a3a-4f29-468c-b52e-c6e588184344 service nova] Creating event network-vif-plugged:cd19f05f-6752-480d-a56b-5d74f03e8e3a for instance d8cfd6f9-be72-41c0-8887-1425b3f5565c on hv-cinder-84130 Jul 07 15:38:02.378671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-0ecf8910-7867-4a6f-b477-0b49dfe0fb08 req-bd244a3a-4f29-468c-b52e-c6e588184344 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028572 Jul 07 15:38:02.379414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 324/643] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:02.646770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0c709d3a-592c-436b-a849-e94ce5b7486b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:02.647398 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0c709d3a-592c-436b-a849-e94ce5b7486b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:02.653964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0c709d3a-592c-436b-a849-e94ce5b7486b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:02.654403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0c709d3a-592c-436b-a849-e94ce5b7486b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:02.655239 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0c709d3a-592c-436b-a849-e94ce5b7486b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:02.655698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0c709d3a-592c-436b-a849-e94ce5b7486b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:02.655949 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:02.657136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:02.663872 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:02.664087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:02.665170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:02.665170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:02.797610 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:02.817629 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=6 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:02.866797 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0c709d3a-592c-436b-a849-e94ce5b7486b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:02.871055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:02.875021 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0c709d3a-592c-436b-a849-e94ce5b7486b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1715 microversion: 2.1 time: 0.232070 Jul 07 15:38:02.875606 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 320/644] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:02 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1715 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:02.879534 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:02.881067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:02.882159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8ba97207-7d42-47be-8594-c102bc2f6d05 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1405 microversion: 2.20 time: 0.230516 Jul 07 15:38:02.882701 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 325/645] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:02 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:38:02.976556 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:02.977041 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:02.983180 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:02.983656 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:02.984413 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:02.984842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:03.036190 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=6 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:03.109019 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] HTTP exception thrown: Cannot 'detach_volume' instance 05028730-a81d-4edf-a4e2-96d672547be4 while it is in vm_state rescued Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Request method failure captured: Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: DELETE /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments/f60f9783-29f4-4af0-933a-ac6fd64f3b7d HTTP/1.1 Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv0JGRXksEBbg0w67HlozL4VW71_ag0hzYbFjCOPe6-Dn4Q6sXAn89l0RxBVWxsLjAvIZwxa2fxfqxK4Ew1N4hRqwmjkN9YjOWMCW1veSaiKYUxr1SaVGN6D8bsYtVz94rH8MgMnXHNMOQ3twr-mW9qa-5kmlnf94Q0d0eQvaqgapjM Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:38:03.111238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8404651e9fb4443a9cdebb3f79a4e6a8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 9528a9a3306d49b0978d77d1ce1ca900 Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:38:03.112850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Cannot 'detach_volume' instance 05028730-a81d-4edf-a4e2-96d672547be4 while it is in vm_state rescued Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'server_id': '05028730-a81d-4edf-a4e2-96d672547be4', 'id': 'f60f9783-29f4-4af0-933a-ac6fd64f3b7d'} Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05028730-a81d-4edf-a4e2-96d672547be4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:38:03.113673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 05028730-a81d-4edf-a4e2-96d672547be4 while it is in vm_state rescued Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 05028730-a81d-4edf-a4e2-96d672547be4 while it is in vm_state rescued Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:03.115220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Returning 409 to user: Cannot 'detach_volume' instance 05028730-a81d-4edf-a4e2-96d672547be4 while it is in vm_state rescued {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:38:03.116432 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-41474989-a3db-4c54-afd3-18c0172814b9 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments/f60f9783-29f4-4af0-933a-ac6fd64f3b7d" status: 409 len: 152 microversion: 2.1 time: 0.140180 Jul 07 15:38:03.116432 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 321/646] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:38:02 2022] DELETE /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments/f60f9783-29f4-4af0-933a-ac6fd64f3b7d => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 07 15:38:03.121698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0dbb0873-c374-4c13-b12b-00fbcead9e66 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:03.122255 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0dbb0873-c374-4c13-b12b-00fbcead9e66 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:03.128321 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0dbb0873-c374-4c13-b12b-00fbcead9e66 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:03.128767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0dbb0873-c374-4c13-b12b-00fbcead9e66 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:03.129516 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0dbb0873-c374-4c13-b12b-00fbcead9e66 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:03.129946 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0dbb0873-c374-4c13-b12b-00fbcead9e66 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:03.364013 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0dbb0873-c374-4c13-b12b-00fbcead9e66 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "POST /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/action" status: 202 len: 0 microversion: 2.1 time: 0.245873 Jul 07 15:38:03.364652 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 326/647] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:38:03 2022] POST /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:38:03.372645 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2b6da855-5baa-4269-8c54-25d66d207e9d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:03.373243 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2b6da855-5baa-4269-8c54-25d66d207e9d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:03.379987 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2b6da855-5baa-4269-8c54-25d66d207e9d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:03.380424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2b6da855-5baa-4269-8c54-25d66d207e9d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:03.381172 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2b6da855-5baa-4269-8c54-25d66d207e9d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:03.381597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2b6da855-5baa-4269-8c54-25d66d207e9d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:03.509293 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2b6da855-5baa-4269-8c54-25d66d207e9d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:03.517848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2b6da855-5baa-4269-8c54-25d66d207e9d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1723 microversion: 2.1 time: 0.149057 Jul 07 15:38:03.518408 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 322/648] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:03 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:03.900458 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:03.901273 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:03.907528 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:03.908000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:03.908894 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:03.909330 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:04.079411 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:04.087200 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:04.089470 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:04.089810 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-96ac0e8d-8de7-49b8-88a0-68bf1b7e7532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1405 microversion: 2.20 time: 0.193699 Jul 07 15:38:04.090358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 327/649] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:03 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:04.536113 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-92d8acb2-fb64-4b15-95ce-d88e2b2116ca tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:04.536815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-92d8acb2-fb64-4b15-95ce-d88e2b2116ca tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:04.543281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-92d8acb2-fb64-4b15-95ce-d88e2b2116ca tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:04.543818 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-92d8acb2-fb64-4b15-95ce-d88e2b2116ca tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:04.544581 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-92d8acb2-fb64-4b15-95ce-d88e2b2116ca tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:04.545007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-92d8acb2-fb64-4b15-95ce-d88e2b2116ca tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:04.692188 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-92d8acb2-fb64-4b15-95ce-d88e2b2116ca tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:04.700153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-92d8acb2-fb64-4b15-95ce-d88e2b2116ca tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1723 microversion: 2.1 time: 0.168642 Jul 07 15:38:04.700756 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 323/650] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:04 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:05.108334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:05.108944 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:05.114880 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:05.115328 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:05.116121 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:05.116560 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:05.321112 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:05.329018 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:05.330517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:05.331687 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-52047e9e-d5ca-4d55-9552-2c8b27150387 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1597 microversion: 2.20 time: 0.227467 Jul 07 15:38:05.332257 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 328/651] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:05 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1597 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:05.349302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b37b81bd-7b88-4a86-9ee1-ec50f1cc2563 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:05.349784 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b37b81bd-7b88-4a86-9ee1-ec50f1cc2563 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:05.356310 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b37b81bd-7b88-4a86-9ee1-ec50f1cc2563 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:05.356756 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b37b81bd-7b88-4a86-9ee1-ec50f1cc2563 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:05.357510 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b37b81bd-7b88-4a86-9ee1-ec50f1cc2563 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:05.358187 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b37b81bd-7b88-4a86-9ee1-ec50f1cc2563 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:05.439356 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b37b81bd-7b88-4a86-9ee1-ec50f1cc2563 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094434 Jul 07 15:38:05.439987 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 324/652] 10.222.0.25 () {60 vars in 1315 bytes} [Thu Jul 7 15:38:05 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:38:05.717989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0d856e67-2b01-4677-8c63-5f2df8eb546c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:05.718512 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0d856e67-2b01-4677-8c63-5f2df8eb546c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:05.725089 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d856e67-2b01-4677-8c63-5f2df8eb546c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:05.725528 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d856e67-2b01-4677-8c63-5f2df8eb546c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:05.726275 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d856e67-2b01-4677-8c63-5f2df8eb546c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:05.726699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d856e67-2b01-4677-8c63-5f2df8eb546c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:05.939510 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0d856e67-2b01-4677-8c63-5f2df8eb546c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:05.947443 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0d856e67-2b01-4677-8c63-5f2df8eb546c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1723 microversion: 2.1 time: 0.233382 Jul 07 15:38:05.948041 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 329/653] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:05 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:06.489776 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-64c040ea-f381-4c9f-b04f-041354e222cf req-69737901-c2ed-49e6-85f7-a6d0af39ff32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cfd6f9-be72-41c0-8887-1425b3f5565c", "tag": "cd19f05f-6752-480d-a56b-5d74f03e8e3a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:06.498218 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-64c040ea-f381-4c9f-b04f-041354e222cf req-69737901-c2ed-49e6-85f7-a6d0af39ff32 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:06.498756 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-64c040ea-f381-4c9f-b04f-041354e222cf req-69737901-c2ed-49e6-85f7-a6d0af39ff32 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:06.510120 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-64c040ea-f381-4c9f-b04f-041354e222cf req-69737901-c2ed-49e6-85f7-a6d0af39ff32 service nova] Creating event network-changed:cd19f05f-6752-480d-a56b-5d74f03e8e3a for instance d8cfd6f9-be72-41c0-8887-1425b3f5565c on hv-cinder-84130 Jul 07 15:38:06.515470 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-64c040ea-f381-4c9f-b04f-041354e222cf req-69737901-c2ed-49e6-85f7-a6d0af39ff32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030105 Jul 07 15:38:06.516194 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 325/654] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:06.967955 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-db75b80d-0212-4f3c-95f2-53cd5a2c5c7e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:06.968661 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-db75b80d-0212-4f3c-95f2-53cd5a2c5c7e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:06.975040 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-db75b80d-0212-4f3c-95f2-53cd5a2c5c7e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:06.975581 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-db75b80d-0212-4f3c-95f2-53cd5a2c5c7e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:06.976442 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-db75b80d-0212-4f3c-95f2-53cd5a2c5c7e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:06.976940 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-db75b80d-0212-4f3c-95f2-53cd5a2c5c7e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:07.227859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-db75b80d-0212-4f3c-95f2-53cd5a2c5c7e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:07.237979 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-db75b80d-0212-4f3c-95f2-53cd5a2c5c7e tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1723 microversion: 2.1 time: 0.275860 Jul 07 15:38:07.238593 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 330/655] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:06 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:07.437206 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-76f7fc79-d1c1-41c9-ac89-bf1ff23923e2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:07.437845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-76f7fc79-d1c1-41c9-ac89-bf1ff23923e2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:07.444794 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76f7fc79-d1c1-41c9-ac89-bf1ff23923e2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:07.445310 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76f7fc79-d1c1-41c9-ac89-bf1ff23923e2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:07.446620 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76f7fc79-d1c1-41c9-ac89-bf1ff23923e2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:07.447244 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76f7fc79-d1c1-41c9-ac89-bf1ff23923e2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:07.470021 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-76f7fc79-d1c1-41c9-ac89-bf1ff23923e2 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/ips" status: 200 len: 150 microversion: 2.1 time: 0.037054 Jul 07 15:38:07.470680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 326/656] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:38:07 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:08.255662 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-34c68379-b40f-4463-9464-d591735623af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:08.256279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-34c68379-b40f-4463-9464-d591735623af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:08.258240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:08.263120 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-34c68379-b40f-4463-9464-d591735623af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:08.263513 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-34c68379-b40f-4463-9464-d591735623af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:08.264302 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-34c68379-b40f-4463-9464-d591735623af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:08.264736 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-34c68379-b40f-4463-9464-d591735623af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:08.399475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-34c68379-b40f-4463-9464-d591735623af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:08.407289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-34c68379-b40f-4463-9464-d591735623af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1729 microversion: 2.1 time: 0.155763 Jul 07 15:38:08.414860 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 331/657] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:08 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:08.423943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0f9c352b-b705-4591-82cc-9cb91c45e42c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:08.424425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0f9c352b-b705-4591-82cc-9cb91c45e42c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:08.430617 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0f9c352b-b705-4591-82cc-9cb91c45e42c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:08.431067 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0f9c352b-b705-4591-82cc-9cb91c45e42c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:08.431864 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0f9c352b-b705-4591-82cc-9cb91c45e42c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:08.432302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0f9c352b-b705-4591-82cc-9cb91c45e42c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:08.509522 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0f9c352b-b705-4591-82cc-9cb91c45e42c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089312 Jul 07 15:38:08.510124 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 327/658] 10.222.0.25 () {58 vars in 1274 bytes} [Thu Jul 7 15:38:08 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:09.095597 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f5e656a7-1679-4887-bc72-df790a1b59dc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca21355c-1d65-4e95-a7b1-c3a61b72c83b"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:09.096694 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f5e656a7-1679-4887-bc72-df790a1b59dc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:09.105386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5e656a7-1679-4887-bc72-df790a1b59dc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:09.105835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5e656a7-1679-4887-bc72-df790a1b59dc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:09.106605 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5e656a7-1679-4887-bc72-df790a1b59dc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:09.107039 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5e656a7-1679-4887-bc72-df790a1b59dc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:09.509295 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-3a2d2853-419d-476a-8e8e-a1def3a7e167 req-67cb2097-e33b-4bc0-b0ea-23f85fbab218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05028730-a81d-4edf-a4e2-96d672547be4", "tag": "1b1ff111-abae-4beb-8edb-da235fcc08f4"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:09.519636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-3a2d2853-419d-476a-8e8e-a1def3a7e167 req-67cb2097-e33b-4bc0-b0ea-23f85fbab218 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:09.520121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-3a2d2853-419d-476a-8e8e-a1def3a7e167 req-67cb2097-e33b-4bc0-b0ea-23f85fbab218 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:09.531534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-3a2d2853-419d-476a-8e8e-a1def3a7e167 req-67cb2097-e33b-4bc0-b0ea-23f85fbab218 service nova] Creating event network-changed:1b1ff111-abae-4beb-8edb-da235fcc08f4 for instance 05028730-a81d-4edf-a4e2-96d672547be4 on hv-cinder-84130 Jul 07 15:38:09.537262 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-3a2d2853-419d-476a-8e8e-a1def3a7e167 req-67cb2097-e33b-4bc0-b0ea-23f85fbab218 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032210 Jul 07 15:38:09.537860 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 328/659] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:38:09.868170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f5e656a7-1679-4887-bc72-df790a1b59dc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776789 Jul 07 15:38:09.869009 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 332/660] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:38:09 2022] POST /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments => generated 194 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:11.553723 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-ecfba16d-8abd-481d-95ac-4130dc5ffebc req-c7aa6524-9cda-4aa8-9f35-527e1ac487f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05028730-a81d-4edf-a4e2-96d672547be4", "tag": "1b1ff111-abae-4beb-8edb-da235fcc08f4"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:11.561846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-ecfba16d-8abd-481d-95ac-4130dc5ffebc req-c7aa6524-9cda-4aa8-9f35-527e1ac487f3 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:11.562286 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-ecfba16d-8abd-481d-95ac-4130dc5ffebc req-c7aa6524-9cda-4aa8-9f35-527e1ac487f3 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:11.572761 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-ecfba16d-8abd-481d-95ac-4130dc5ffebc req-c7aa6524-9cda-4aa8-9f35-527e1ac487f3 service nova] Creating event network-changed:1b1ff111-abae-4beb-8edb-da235fcc08f4 for instance 05028730-a81d-4edf-a4e2-96d672547be4 on hv-cinder-84130 Jul 07 15:38:11.577555 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-ecfba16d-8abd-481d-95ac-4130dc5ffebc req-c7aa6524-9cda-4aa8-9f35-527e1ac487f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028292 Jul 07 15:38:11.578117 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 329/661] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:13.427900 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:38:13.428429 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Thu Jul 7 15:38:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:38:17.263778 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2c54c798-7b6c-4a40-90ad-69e0f6f00b8d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:17.264837 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2c54c798-7b6c-4a40-90ad-69e0f6f00b8d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:17.271264 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2c54c798-7b6c-4a40-90ad-69e0f6f00b8d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.271579 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2c54c798-7b6c-4a40-90ad-69e0f6f00b8d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.272344 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2c54c798-7b6c-4a40-90ad-69e0f6f00b8d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.272780 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2c54c798-7b6c-4a40-90ad-69e0f6f00b8d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.303295 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2c54c798-7b6c-4a40-90ad-69e0f6f00b8d tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044502 Jul 07 15:38:17.303958 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 333/662] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:38:17 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:38:17.362758 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-637824a3-013e-403b-997a-3000d9404438 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:17.363336 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-637824a3-013e-403b-997a-3000d9404438 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:17.369571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-637824a3-013e-403b-997a-3000d9404438 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.370018 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-637824a3-013e-403b-997a-3000d9404438 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.370845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-637824a3-013e-403b-997a-3000d9404438 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.371284 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-637824a3-013e-403b-997a-3000d9404438 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.397433 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-637824a3-013e-403b-997a-3000d9404438 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Going to try to terminate instance {{(pid=124720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:38:17.420691 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca21355c-1d65-4e95-a7b1-c3a61b72c83b"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:17.421730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:17.428496 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.428936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.429685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.430111 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.517047 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Invalid volume: volume ca21355c-1d65-4e95-a7b1-c3a61b72c83b is already attached to instances: 285e8356-8fad-43f7-ae21-52104c0b453f Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: POST /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments HTTP/1.1 Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 74 Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:38:17.518801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {"volumeAttachment": {"volumeId": "ca21355c-1d65-4e95-a7b1-c3a61b72c83b"}} Jul 07 15:38:17.525045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Invalid volume: volume ca21355c-1d65-4e95-a7b1-c3a61b72c83b is already attached to instances: 285e8356-8fad-43f7-ae21-52104c0b453f Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'server_id': '285e8356-8fad-43f7-ae21-52104c0b453f', 'body': {'volumeAttachment': {'volumeId': 'ca21355c-1d65-4e95-a7b1-c3a61b72c83b'}}} Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ca21355c-1d65-4e95-a7b1-c3a61b72c83b is already attached to instances: 285e8356-8fad-43f7-ae21-52104c0b453f Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:17.525959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ca21355c-1d65-4e95-a7b1-c3a61b72c83b is already attached to instances: 285e8356-8fad-43f7-ae21-52104c0b453f Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:17.527813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:17.530055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:17.530055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:38:17.530055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:38:17.530055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ca21355c-1d65-4e95-a7b1-c3a61b72c83b is already attached to instances: 285e8356-8fad-43f7-ae21-52104c0b453f Jul 07 15:38:17.530055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:17.530055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 400 to user: Invalid volume: volume ca21355c-1d65-4e95-a7b1-c3a61b72c83b is already attached to instances: 285e8356-8fad-43f7-ae21-52104c0b453f {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:38:17.530055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3a519dec-ea1c-4e2f-8954-14604914110e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103622 Jul 07 15:38:17.530055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 334/663] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:38:17 2022] POST /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 07 15:38:17.581133 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fa7335e9-0f02-4165-9b56-f10ed4a870eb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:17.581647 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fa7335e9-0f02-4165-9b56-f10ed4a870eb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:17.588394 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fa7335e9-0f02-4165-9b56-f10ed4a870eb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.588834 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fa7335e9-0f02-4165-9b56-f10ed4a870eb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.589581 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fa7335e9-0f02-4165-9b56-f10ed4a870eb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.590009 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fa7335e9-0f02-4165-9b56-f10ed4a870eb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.674805 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-637824a3-013e-403b-997a-3000d9404438 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 204 len: 0 microversion: 2.1 time: 0.317506 Jul 07 15:38:17.675611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-fa7335e9-0f02-4165-9b56-f10ed4a870eb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lazy-loading 'services' on Instance uuid 285e8356-8fad-43f7-ae21-52104c0b453f {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:38:17.675929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 330/664] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:38:17 2022] DELETE /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:38:17.684619 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-301caf5a-b3d8-4c4a-8c93-daa967f3b76a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:17.685430 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-301caf5a-b3d8-4c4a-8c93-daa967f3b76a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:17.691443 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-301caf5a-b3d8-4c4a-8c93-daa967f3b76a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.691924 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-301caf5a-b3d8-4c4a-8c93-daa967f3b76a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.692678 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-301caf5a-b3d8-4c4a-8c93-daa967f3b76a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.693112 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-301caf5a-b3d8-4c4a-8c93-daa967f3b76a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.825189 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-301caf5a-b3d8-4c4a-8c93-daa967f3b76a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:17.835683 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-301caf5a-b3d8-4c4a-8c93-daa967f3b76a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1670 microversion: 2.1 time: 0.155145 Jul 07 15:38:17.836252 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 331/665] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:17 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:17.879558 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fa7335e9-0f02-4165-9b56-f10ed4a870eb tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments/ca21355c-1d65-4e95-a7b1-c3a61b72c83b" status: 202 len: 0 microversion: 2.1 time: 0.302079 Jul 07 15:38:17.880178 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 335/666] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:38:17 2022] DELETE /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments/ca21355c-1d65-4e95-a7b1-c3a61b72c83b => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 15:38:17.888359 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-924c8382-6a29-48a7-9998-b3fa2148dfb7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:17.889382 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-924c8382-6a29-48a7-9998-b3fa2148dfb7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:17.896002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-924c8382-6a29-48a7-9998-b3fa2148dfb7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.896467 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-924c8382-6a29-48a7-9998-b3fa2148dfb7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.897209 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-924c8382-6a29-48a7-9998-b3fa2148dfb7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:17.897642 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-924c8382-6a29-48a7-9998-b3fa2148dfb7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:17.926434 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-924c8382-6a29-48a7-9998-b3fa2148dfb7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041981 Jul 07 15:38:17.926970 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 332/667] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:38:17 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:18.855025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5163a5e0-61dd-4814-94e8-b7107e25de33 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:18.855746 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5163a5e0-61dd-4814-94e8-b7107e25de33 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:18.862801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5163a5e0-61dd-4814-94e8-b7107e25de33 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:18.863242 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5163a5e0-61dd-4814-94e8-b7107e25de33 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:18.864019 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5163a5e0-61dd-4814-94e8-b7107e25de33 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:18.864445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5163a5e0-61dd-4814-94e8-b7107e25de33 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:18.938083 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d749edc8-1994-46bd-a2c9-33f788781670 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:18.939111 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d749edc8-1994-46bd-a2c9-33f788781670 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:18.945731 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d749edc8-1994-46bd-a2c9-33f788781670 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:18.946250 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d749edc8-1994-46bd-a2c9-33f788781670 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:18.947080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d749edc8-1994-46bd-a2c9-33f788781670 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:18.947617 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d749edc8-1994-46bd-a2c9-33f788781670 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:18.977815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d749edc8-1994-46bd-a2c9-33f788781670 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043693 Jul 07 15:38:18.978381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 333/668] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:38:18 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:38:18.994839 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5163a5e0-61dd-4814-94e8-b7107e25de33 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:19.002257 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5163a5e0-61dd-4814-94e8-b7107e25de33 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1670 microversion: 2.1 time: 0.151894 Jul 07 15:38:19.002808 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 336/669] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:18 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:19.990093 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5dec4bff-db31-47fb-a676-51e7b8ad8d22 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:19.991014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5dec4bff-db31-47fb-a676-51e7b8ad8d22 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:19.997530 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5dec4bff-db31-47fb-a676-51e7b8ad8d22 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:19.997974 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5dec4bff-db31-47fb-a676-51e7b8ad8d22 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:19.998727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5dec4bff-db31-47fb-a676-51e7b8ad8d22 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:19.999175 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5dec4bff-db31-47fb-a676-51e7b8ad8d22 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:20.019339 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-acb7e02c-71ec-4d32-8c4a-96b9b1d2a714 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:20.020003 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-acb7e02c-71ec-4d32-8c4a-96b9b1d2a714 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:20.026488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-acb7e02c-71ec-4d32-8c4a-96b9b1d2a714 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:20.026940 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-acb7e02c-71ec-4d32-8c4a-96b9b1d2a714 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:20.027741 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-acb7e02c-71ec-4d32-8c4a-96b9b1d2a714 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:20.027863 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5dec4bff-db31-47fb-a676-51e7b8ad8d22 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042142 Jul 07 15:38:20.028178 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-acb7e02c-71ec-4d32-8c4a-96b9b1d2a714 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:20.028389 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 334/670] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:38:19 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:20.042833 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:20.155776 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-acb7e02c-71ec-4d32-8c4a-96b9b1d2a714 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:20.163082 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-acb7e02c-71ec-4d32-8c4a-96b9b1d2a714 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1670 microversion: 2.1 time: 0.147622 Jul 07 15:38:20.163670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 337/671] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:20 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:21.039180 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-afa8c27d-fe6a-49fe-805d-19a7c81d2e16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:21.040177 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-afa8c27d-fe6a-49fe-805d-19a7c81d2e16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:21.046759 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-afa8c27d-fe6a-49fe-805d-19a7c81d2e16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:21.047281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-afa8c27d-fe6a-49fe-805d-19a7c81d2e16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:21.048148 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-afa8c27d-fe6a-49fe-805d-19a7c81d2e16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:21.049173 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-afa8c27d-fe6a-49fe-805d-19a7c81d2e16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:21.081968 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-afa8c27d-fe6a-49fe-805d-19a7c81d2e16 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045515 Jul 07 15:38:21.081968 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 335/672] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:38:21 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:38:21.123727 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-e47ecda0-91b4-4c74-b961-0c67b15448d3 req-b0e5c9d1-7a6b-4d1d-b9b4-d207a016238e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5788db1-1101-4334-abdd-2f11d074751a", "name": "network-vif-deleted", "tag": "647ad2af-c816-4ebc-a882-af1290b500a2"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:21.132606 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-e47ecda0-91b4-4c74-b961-0c67b15448d3 req-b0e5c9d1-7a6b-4d1d-b9b4-d207a016238e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:21.133044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-e47ecda0-91b4-4c74-b961-0c67b15448d3 req-b0e5c9d1-7a6b-4d1d-b9b4-d207a016238e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:21.144807 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-e47ecda0-91b4-4c74-b961-0c67b15448d3 req-b0e5c9d1-7a6b-4d1d-b9b4-d207a016238e service nova] Creating event network-vif-deleted:647ad2af-c816-4ebc-a882-af1290b500a2 for instance a5788db1-1101-4334-abdd-2f11d074751a on hv-cinder-84130 Jul 07 15:38:21.150246 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-e47ecda0-91b4-4c74-b961-0c67b15448d3 req-b0e5c9d1-7a6b-4d1d-b9b4-d207a016238e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029996 Jul 07 15:38:21.151218 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 338/673] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:21.152720 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c0e9b18f-8d2a-442e-ba7f-b106c047c80f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:21.153264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c0e9b18f-8d2a-442e-ba7f-b106c047c80f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:21.160669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c0e9b18f-8d2a-442e-ba7f-b106c047c80f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:21.161365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c0e9b18f-8d2a-442e-ba7f-b106c047c80f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:21.162322 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c0e9b18f-8d2a-442e-ba7f-b106c047c80f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:21.163927 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c0e9b18f-8d2a-442e-ba7f-b106c047c80f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:21.169088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:21.187601 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d2de5950-ce28-4e1c-af2b-7bdb094473e0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:21.188326 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d2de5950-ce28-4e1c-af2b-7bdb094473e0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:21.195972 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d2de5950-ce28-4e1c-af2b-7bdb094473e0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:21.196425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d2de5950-ce28-4e1c-af2b-7bdb094473e0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:21.196740 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c0e9b18f-8d2a-442e-ba7f-b106c047c80f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Going to try to terminate instance {{(pid=124720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:38:21.197264 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d2de5950-ce28-4e1c-af2b-7bdb094473e0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:21.197700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d2de5950-ce28-4e1c-af2b-7bdb094473e0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:21.274957 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d2de5950-ce28-4e1c-af2b-7bdb094473e0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:21.283859 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d2de5950-ce28-4e1c-af2b-7bdb094473e0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1603 microversion: 2.1 time: 0.105696 Jul 07 15:38:21.284447 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 339/674] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:21 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1603 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:21.708738 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c0e9b18f-8d2a-442e-ba7f-b106c047c80f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 204 len: 0 microversion: 2.1 time: 0.561617 Jul 07 15:38:21.709405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 336/675] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:38:21 2022] DELETE /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:38:21.717475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e27494a0-59cc-4dc9-a89d-adbb406061ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:21.718178 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e27494a0-59cc-4dc9-a89d-adbb406061ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:21.724791 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e27494a0-59cc-4dc9-a89d-adbb406061ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:21.725323 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e27494a0-59cc-4dc9-a89d-adbb406061ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:21.726193 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e27494a0-59cc-4dc9-a89d-adbb406061ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:21.727155 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e27494a0-59cc-4dc9-a89d-adbb406061ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:22.096688 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e27494a0-59cc-4dc9-a89d-adbb406061ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:22.104427 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e27494a0-59cc-4dc9-a89d-adbb406061ea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1681 microversion: 2.1 time: 0.390729 Jul 07 15:38:22.105001 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 340/676] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:21 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1681 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:22.302094 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:22.302783 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:22.309478 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:22.309920 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:22.310680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:22.311106 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:22.344391 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:22.344838 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:22.345278 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lazy-loading 'fault' on Instance uuid a5788db1-1101-4334-abdd-2f11d074751a {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:38:22.387019 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:22.394475 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d1f4e2ca-5e60-4cc0-a1c5-d0e52c5b23cd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1326 microversion: 2.1 time: 0.097194 Jul 07 15:38:22.395049 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 337/677] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:22 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:23.122159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-910f9d52-f5ac-4798-96d8-75cc3b140126 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:23.122799 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-910f9d52-f5ac-4798-96d8-75cc3b140126 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:23.129557 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-910f9d52-f5ac-4798-96d8-75cc3b140126 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:23.130002 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-910f9d52-f5ac-4798-96d8-75cc3b140126 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:23.130767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-910f9d52-f5ac-4798-96d8-75cc3b140126 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:23.131199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-910f9d52-f5ac-4798-96d8-75cc3b140126 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:23.257524 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-910f9d52-f5ac-4798-96d8-75cc3b140126 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:23.264916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-910f9d52-f5ac-4798-96d8-75cc3b140126 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1681 microversion: 2.1 time: 0.146899 Jul 07 15:38:23.265477 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 341/678] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:23 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:23.413500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:23.413500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:23.419381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:23.419853 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:23.420609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:23.421045 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:23.452198 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:23.452198 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:23.452435 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lazy-loading 'fault' on Instance uuid a5788db1-1101-4334-abdd-2f11d074751a {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:38:23.495319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:23.503235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-22f63e7b-ff98-4d1a-84ec-7e4c3b8c6054 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 200 len: 1326 microversion: 2.1 time: 0.095276 Jul 07 15:38:23.506262 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 338/679] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:23 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:24.282352 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-54d50a83-d747-4d1c-a24f-29b52f89659c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:24.283673 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-54d50a83-d747-4d1c-a24f-29b52f89659c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:24.290157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54d50a83-d747-4d1c-a24f-29b52f89659c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:24.290627 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54d50a83-d747-4d1c-a24f-29b52f89659c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:24.291383 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54d50a83-d747-4d1c-a24f-29b52f89659c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:24.291829 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54d50a83-d747-4d1c-a24f-29b52f89659c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:24.382957 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-54d50a83-d747-4d1c-a24f-29b52f89659c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:24.390450 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-54d50a83-d747-4d1c-a24f-29b52f89659c tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1614 microversion: 2.1 time: 0.112046 Jul 07 15:38:24.391217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 342/680] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:24 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:24.453567 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-14610e36-457e-4517-8e9c-b1fc367a3331 req-7a218915-2853-4d67-8b3d-59544d62348c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285e8356-8fad-43f7-ae21-52104c0b453f", "name": "network-vif-deleted", "tag": "e7e5d408-0caa-4043-a605-2348d4827ea2"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:24.462626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-14610e36-457e-4517-8e9c-b1fc367a3331 req-7a218915-2853-4d67-8b3d-59544d62348c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:24.463008 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-14610e36-457e-4517-8e9c-b1fc367a3331 req-7a218915-2853-4d67-8b3d-59544d62348c service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:24.474892 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-14610e36-457e-4517-8e9c-b1fc367a3331 req-7a218915-2853-4d67-8b3d-59544d62348c service nova] Creating event network-vif-deleted:e7e5d408-0caa-4043-a605-2348d4827ea2 for instance 285e8356-8fad-43f7-ae21-52104c0b453f on hv-cinder-84130 Jul 07 15:38:24.481248 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-14610e36-457e-4517-8e9c-b1fc367a3331 req-7a218915-2853-4d67-8b3d-59544d62348c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031327 Jul 07 15:38:24.486740 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 339/681] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:24.520618 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:24.521236 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:24.527339 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:24.527824 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:24.528598 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:24.529032 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:24.543887 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] HTTP exception thrown: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Request method failure captured: Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a HTTP/1.1 Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy4Bof_843o2DVyTzX5FJ-YmZ3i_HY_vfbxwHjwXODW-3y3CDlMJvP3xz5753SOFCtZ5oMsOoXZcwyDzDaKnMWg4dll3riIL60tL9hC8bhj7vbW3T_IPa1WcFvtWQfLiEHq23wJwKKXOITcPz1aeowoAQW7iysd-0HRlhORRpU3KqM Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:38:24.550667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66a98614df914018b7ecfb68afb735c0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b5dec80a83aa463b99bd298ab09dfbdb Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:38:24.552596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'a5788db1-1101-4334-abdd-2f11d074751a'} Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:38:24.553418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:38:24.554670 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:24.557220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Returning 404 to user: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:38:24.557220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-90b7a246-2c1b-455f-95ab-f97c6ce8d2d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 404 len: 111 microversion: 2.1 time: 0.030803 Jul 07 15:38:24.557220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 343/682] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:24 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:38:24.557770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-32d2dd2a-ba94-4117-8fb3-a230d712a665 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '.version_select at 0x7f5248ef4dc0>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:24.641240 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-32d2dd2a-ba94-4117-8fb3-a230d712a665 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920059883" status: 202 len: 0 microversion: 2.1 time: 0.087897 Jul 07 15:38:24.641883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 340/683] 10.222.0.25 () {58 vars in 1217 bytes} [Thu Jul 7 15:38:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920059883 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:38:25.407751 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:25.411357 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:25.414580 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:25.415030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:25.415827 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:25.416266 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:25.448054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9d884735-085e-4f1c-95ba-fe795f41832f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'create', calling method: .version_select at 0x7f5248dfd550>, body: {"keypair": {"name": "tempest-keypair-694634069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa9ddpsNi4qGFuceJVVKYqeODRvfVnp9o6u0c8unqscfhEluQvp7lt+M43WDXS7XOL0GDBinAu1mT+WdEaet0by+iKWE1bp+Tk5qYLDOwtt5Y4eJNdmJRgo2ozfhCUGzA=="}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:25.458657 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:25.459107 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:25.459557 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lazy-loading 'fault' on Instance uuid 285e8356-8fad-43f7-ae21-52104c0b453f {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:38:25.465943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-9d884735-085e-4f1c-95ba-fe795f41832f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Getting quotas for project 66a98614df914018b7ecfb68afb735c0. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:38:25.469964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-9d884735-085e-4f1c-95ba-fe795f41832f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Getting quotas for user b5dec80a83aa463b99bd298ab09dfbdb and project 66a98614df914018b7ecfb68afb735c0. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:38:25.513138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:25.521572 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a878a2a1-e79e-46fe-9f8f-54b732630a37 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 200 len: 1331 microversion: 2.1 time: 0.117729 Jul 07 15:38:25.522391 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 344/684] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:25 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:25.605117 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9d884735-085e-4f1c-95ba-fe795f41832f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161961 Jul 07 15:38:25.605722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 341/685] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:38:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:26.538446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:26.539059 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:26.545791 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:26.546254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:26.547038 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:26.547474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:26.560715 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f HTTP/1.1 Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:38:26.567199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:38:26.568794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '285e8356-8fad-43f7-ae21-52104c0b453f'} Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:38:26.569577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:38:26.570757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:38:26.571918 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:38:26.571918 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-932613d5-f602-4a2e-92f2-b685ded64555 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 404 len: 111 microversion: 2.1 time: 0.029252 Jul 07 15:38:26.571918 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 345/686] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:26 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:38:26.574702 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a6617812-22e6-4b99-b9df-b886f9f6c467 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '.version_select at 0x7f5248dfd820>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:26.691375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a6617812-22e6-4b99-b9df-b886f9f6c467 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226166688" status: 202 len: 0 microversion: 2.1 time: 0.120834 Jul 07 15:38:26.692092 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 342/687] 10.222.0.25 () {58 vars in 1220 bytes} [Thu Jul 7 15:38:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226166688 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:38:27.518883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f04b5078-70f3-4d1f-b1c5-c0c58c9d7093 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: .version_select at 0x7f5249600ee0>, body: {"keypair": {"name": "tempest-keypair-1804621041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU8EuGF5dpesOix5ZXc+H4Crvkte+/6Jntm/6ClWqgbTY2Jigs12kGuTI6xKAV3YbGCE/ZYiUiOvOgr8VdtiML95v4s3Oiohj1RYt77ANjK64nqrv/BlXj/xIVedB/noA=="}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:27.532537 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-f04b5078-70f3-4d1f-b1c5-c0c58c9d7093 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'key_pairs'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:38:27.537033 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-f04b5078-70f3-4d1f-b1c5-c0c58c9d7093 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for user b2e09539caff4d4698cf29c1ea22d365 and project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'key_pairs'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:38:27.630229 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-759791982", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75a15ea6-f7b1-407c-a2e7-8816149570d9"}], "security_groups": [{"name": "tempest-securitygroup--1668321322"}], "key_name": "tempest-keypair-694634069", "user_data": "}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:27.639916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f04b5078-70f3-4d1f-b1c5-c0c58c9d7093 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125967 Jul 07 15:38:27.642001 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 346/688] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:38:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:27.731624 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] validate_networks() for [('75a15ea6-f7b1-407c-a2e7-8816149570d9', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:38:28.197388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:38:28.197879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:38:28.198424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:38:28.198904 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:38:28.199392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:38:28.208389 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:28.208937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:28.209812 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:28.210317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:28.226971 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Getting quotas for project 66a98614df914018b7ecfb68afb735c0. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:38:28.231015 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Getting quotas for user b5dec80a83aa463b99bd298ab09dfbdb and project 66a98614df914018b7ecfb68afb735c0. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:38:28.250302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:38:28.253290 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:38:28.350597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6ee17049-6cbd-4ecb-b413-06852a73d747 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725188 Jul 07 15:38:28.351251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 343/689] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:38:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 07 15:38:28.362088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0c61752c-2b45-45ad-8259-8d285c1bff94 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:28.362790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0c61752c-2b45-45ad-8259-8d285c1bff94 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:28.436588 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0c61752c-2b45-45ad-8259-8d285c1bff94 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:28.444018 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0c61752c-2b45-45ad-8259-8d285c1bff94 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1236 microversion: 2.1 time: 0.086617 Jul 07 15:38:28.448990 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 347/690] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:28 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1236 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:29.461019 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-61976147-48f7-47f9-8198-33bbb504f1c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:29.461663 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-61976147-48f7-47f9-8198-33bbb504f1c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:29.468055 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-61976147-48f7-47f9-8198-33bbb504f1c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:29.468507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-61976147-48f7-47f9-8198-33bbb504f1c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:29.469265 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-61976147-48f7-47f9-8198-33bbb504f1c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:29.469711 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-61976147-48f7-47f9-8198-33bbb504f1c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:29.531372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-61976147-48f7-47f9-8198-33bbb504f1c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:29.539261 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-61976147-48f7-47f9-8198-33bbb504f1c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1240 microversion: 2.1 time: 0.082294 Jul 07 15:38:29.539859 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 344/691] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:29 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:30.054074 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1264687267", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac1a0dbf-9ce9-4f3d-9709-351b088f4833"}], "security_groups": [{"name": "tempest-securitygroup--847404265"}], "key_name": "tempest-keypair-1804621041", "user_data": "}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:30.155896 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.network.neutron [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] validate_networks() for [('ac1a0dbf-9ce9-4f3d-9709-351b088f4833', None, None, None, None, None)] {{(pid=124719) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:38:30.556357 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-537d14fe-8e49-47ae-8d16-fbbff0b4823e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:30.556963 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-537d14fe-8e49-47ae-8d16-fbbff0b4823e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:30.564316 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-537d14fe-8e49-47ae-8d16-fbbff0b4823e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:30.565426 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-537d14fe-8e49-47ae-8d16-fbbff0b4823e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:30.566198 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-537d14fe-8e49-47ae-8d16-fbbff0b4823e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:30.566635 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-537d14fe-8e49-47ae-8d16-fbbff0b4823e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:30.679360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-537d14fe-8e49-47ae-8d16-fbbff0b4823e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:30.687388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-537d14fe-8e49-47ae-8d16-fbbff0b4823e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1296 microversion: 2.1 time: 0.134994 Jul 07 15:38:30.688210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 345/692] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:30 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1296 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:30.718541 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Flavor limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:38:30.719160 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Image limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:38:30.719852 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Flavor pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:38:30.720414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Image pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:38:30.720999 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:38:30.730282 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:30.730725 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:30.731511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:30.731976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:30.755655 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:38:30.760273 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Getting quotas for user b2e09539caff4d4698cf29c1ea22d365 and project 66b37250ea6d4c4eb242c27ce9819dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:38:30.772097 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Going to run 1 instances... {{(pid=124719) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:38:30.774362 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:38:30.922003 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3b83896b-d044-4b2e-b698-58d6e5b507a5 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.872138 Jul 07 15:38:30.922634 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 348/693] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:38:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:38:30.933358 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-873f8167-f235-4530-a21b-acb27a7a89e0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:30.933973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-873f8167-f235-4530-a21b-acb27a7a89e0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:30.936677 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:31.007089 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-873f8167-f235-4530-a21b-acb27a7a89e0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:31.014185 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-873f8167-f235-4530-a21b-acb27a7a89e0 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1242 microversion: 2.1 time: 0.084790 Jul 07 15:38:31.014755 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 346/694] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:30 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:31.706773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-38b9e489-35b3-4f50-a5ca-c588e2f8f931 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:31.707255 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-38b9e489-35b3-4f50-a5ca-c588e2f8f931 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:31.717254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-38b9e489-35b3-4f50-a5ca-c588e2f8f931 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:31.717879 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-38b9e489-35b3-4f50-a5ca-c588e2f8f931 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:31.718666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-38b9e489-35b3-4f50-a5ca-c588e2f8f931 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:31.719104 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-38b9e489-35b3-4f50-a5ca-c588e2f8f931 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:32.031263 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2b3389c0-1891-4185-8ed6-2fdc701489ae tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:32.031958 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2b3389c0-1891-4185-8ed6-2fdc701489ae tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:32.041470 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2b3389c0-1891-4185-8ed6-2fdc701489ae tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:32.041927 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2b3389c0-1891-4185-8ed6-2fdc701489ae tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:32.042697 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2b3389c0-1891-4185-8ed6-2fdc701489ae tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:32.043129 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2b3389c0-1891-4185-8ed6-2fdc701489ae tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:32.130863 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2b3389c0-1891-4185-8ed6-2fdc701489ae tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:32.138332 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2b3389c0-1891-4185-8ed6-2fdc701489ae tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1246 microversion: 2.1 time: 0.111424 Jul 07 15:38:32.138970 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 347/695] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:32 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:32.197233 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-38b9e489-35b3-4f50-a5ca-c588e2f8f931 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:32.204862 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-38b9e489-35b3-4f50-a5ca-c588e2f8f931 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1362 microversion: 2.1 time: 0.503164 Jul 07 15:38:32.205656 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 349/696] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:31 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1362 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:32.731192 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-8cc39dc6-fb95-4482-9254-a7e39eecee09 req-73d8ef20-334d-4492-adc5-9d3a86ec20df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1243dbb-87ee-43ac-8729-d18c53114d43", "tag": "2482ebe6-1259-4f2f-83d7-763ce7639812"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:32.741740 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-8cc39dc6-fb95-4482-9254-a7e39eecee09 req-73d8ef20-334d-4492-adc5-9d3a86ec20df service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:32.742267 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-8cc39dc6-fb95-4482-9254-a7e39eecee09 req-73d8ef20-334d-4492-adc5-9d3a86ec20df service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:32.760576 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-8cc39dc6-fb95-4482-9254-a7e39eecee09 req-73d8ef20-334d-4492-adc5-9d3a86ec20df service nova] Creating event network-changed:2482ebe6-1259-4f2f-83d7-763ce7639812 for instance b1243dbb-87ee-43ac-8729-d18c53114d43 on hv-cinder-84130 Jul 07 15:38:32.766349 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-8cc39dc6-fb95-4482-9254-a7e39eecee09 req-73d8ef20-334d-4492-adc5-9d3a86ec20df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041163 Jul 07 15:38:32.767201 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 348/697] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:33.155123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2d7b00df-1a1a-4f06-9f53-2c587413981b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:33.155874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2d7b00df-1a1a-4f06-9f53-2c587413981b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:33.166584 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d7b00df-1a1a-4f06-9f53-2c587413981b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:33.167130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d7b00df-1a1a-4f06-9f53-2c587413981b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:33.168163 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d7b00df-1a1a-4f06-9f53-2c587413981b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:33.168808 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2d7b00df-1a1a-4f06-9f53-2c587413981b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:33.223620 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-100c545a-b258-4ddf-8086-10b7d06ba6f3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:33.224662 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-100c545a-b258-4ddf-8086-10b7d06ba6f3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:33.231828 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-100c545a-b258-4ddf-8086-10b7d06ba6f3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:33.232560 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-100c545a-b258-4ddf-8086-10b7d06ba6f3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:33.233713 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-100c545a-b258-4ddf-8086-10b7d06ba6f3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:33.234303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-100c545a-b258-4ddf-8086-10b7d06ba6f3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:33.288304 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2d7b00df-1a1a-4f06-9f53-2c587413981b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:33.296674 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2d7b00df-1a1a-4f06-9f53-2c587413981b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1312 microversion: 2.1 time: 0.145858 Jul 07 15:38:33.307106 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 350/698] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:33 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:33.399283 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-100c545a-b258-4ddf-8086-10b7d06ba6f3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:33.407059 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-100c545a-b258-4ddf-8086-10b7d06ba6f3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1362 microversion: 2.1 time: 0.188379 Jul 07 15:38:33.412075 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 349/699] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:33 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:34.314322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-49369a9c-21c1-4768-a406-3c895c8b35b8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:34.315489 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-49369a9c-21c1-4768-a406-3c895c8b35b8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:34.321931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-49369a9c-21c1-4768-a406-3c895c8b35b8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:34.322371 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-49369a9c-21c1-4768-a406-3c895c8b35b8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:34.323124 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-49369a9c-21c1-4768-a406-3c895c8b35b8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:34.323552 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-49369a9c-21c1-4768-a406-3c895c8b35b8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:34.423596 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b5ef241f-b23e-45ee-9160-13690803fd35 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:34.424937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b5ef241f-b23e-45ee-9160-13690803fd35 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:34.431719 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b5ef241f-b23e-45ee-9160-13690803fd35 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:34.432145 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b5ef241f-b23e-45ee-9160-13690803fd35 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:34.432896 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b5ef241f-b23e-45ee-9160-13690803fd35 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:34.433322 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b5ef241f-b23e-45ee-9160-13690803fd35 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:34.450671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-49369a9c-21c1-4768-a406-3c895c8b35b8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:34.458143 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-49369a9c-21c1-4768-a406-3c895c8b35b8 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1367 microversion: 2.1 time: 0.147773 Jul 07 15:38:34.458716 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 351/700] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:34 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:34.564476 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b5ef241f-b23e-45ee-9160-13690803fd35 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:34.571817 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b5ef241f-b23e-45ee-9160-13690803fd35 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1362 microversion: 2.1 time: 0.152000 Jul 07 15:38:34.572373 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 350/701] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:34 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:35.474711 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c2b18ded-43cb-4825-a4d5-985e8c990977 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:35.475272 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c2b18ded-43cb-4825-a4d5-985e8c990977 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:35.482409 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c2b18ded-43cb-4825-a4d5-985e8c990977 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:35.483177 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c2b18ded-43cb-4825-a4d5-985e8c990977 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:35.484532 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c2b18ded-43cb-4825-a4d5-985e8c990977 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:35.484961 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c2b18ded-43cb-4825-a4d5-985e8c990977 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:35.588403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4b7c6988-c5f5-48db-bb5e-59d475a644b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:35.592403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4b7c6988-c5f5-48db-bb5e-59d475a644b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:35.600360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4b7c6988-c5f5-48db-bb5e-59d475a644b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:35.600832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4b7c6988-c5f5-48db-bb5e-59d475a644b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:35.601785 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4b7c6988-c5f5-48db-bb5e-59d475a644b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:35.602219 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4b7c6988-c5f5-48db-bb5e-59d475a644b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:35.631402 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c2b18ded-43cb-4825-a4d5-985e8c990977 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:35.639916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c2b18ded-43cb-4825-a4d5-985e8c990977 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1367 microversion: 2.1 time: 0.168637 Jul 07 15:38:35.641372 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 352/702] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:35 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:35.763476 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-4b7c6988-c5f5-48db-bb5e-59d475a644b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:35.772088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4b7c6988-c5f5-48db-bb5e-59d475a644b2 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1362 microversion: 2.1 time: 0.187405 Jul 07 15:38:35.772663 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 351/703] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:35 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:35.773284 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-a63cfd6e-1a94-4d74-9a13-14b6b374903d req-0e8fc222-eb02-4802-949f-23651bde9863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54a14c0-4b58-4edc-9325-b1c7da38307d", "tag": "8bf95f95-95f0-423b-b959-585f3cb8cc66"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:35.782138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-a63cfd6e-1a94-4d74-9a13-14b6b374903d req-0e8fc222-eb02-4802-949f-23651bde9863 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:35.782614 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-a63cfd6e-1a94-4d74-9a13-14b6b374903d req-0e8fc222-eb02-4802-949f-23651bde9863 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:35.796140 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-a63cfd6e-1a94-4d74-9a13-14b6b374903d req-0e8fc222-eb02-4802-949f-23651bde9863 service nova] Creating event network-changed:8bf95f95-95f0-423b-b959-585f3cb8cc66 for instance e54a14c0-4b58-4edc-9325-b1c7da38307d on hv-cinder-84130 Jul 07 15:38:35.801681 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-a63cfd6e-1a94-4d74-9a13-14b6b374903d req-0e8fc222-eb02-4802-949f-23651bde9863 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118967 Jul 07 15:38:35.802659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 353/704] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:36.657444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e3e0d309-6713-44aa-943e-214a7a6bbf48 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:36.658062 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e3e0d309-6713-44aa-943e-214a7a6bbf48 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:36.665751 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e3e0d309-6713-44aa-943e-214a7a6bbf48 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:36.666196 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e3e0d309-6713-44aa-943e-214a7a6bbf48 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:36.666955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e3e0d309-6713-44aa-943e-214a7a6bbf48 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:36.667411 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e3e0d309-6713-44aa-943e-214a7a6bbf48 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:36.790085 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-836b1760-77ba-4d46-a686-ff57080a997e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:36.790772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-836b1760-77ba-4d46-a686-ff57080a997e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:36.797348 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-836b1760-77ba-4d46-a686-ff57080a997e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:36.797788 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-836b1760-77ba-4d46-a686-ff57080a997e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:36.798575 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-836b1760-77ba-4d46-a686-ff57080a997e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:36.799640 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-836b1760-77ba-4d46-a686-ff57080a997e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:36.808429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e3e0d309-6713-44aa-943e-214a7a6bbf48 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:36.815713 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e3e0d309-6713-44aa-943e-214a7a6bbf48 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1367 microversion: 2.1 time: 0.162057 Jul 07 15:38:36.816280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 352/705] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:36 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:36.933861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-836b1760-77ba-4d46-a686-ff57080a997e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:36.941408 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-836b1760-77ba-4d46-a686-ff57080a997e tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1362 microversion: 2.1 time: 0.155480 Jul 07 15:38:36.941971 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 354/706] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:36 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:37.834090 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6591bdc6-918e-414d-a76c-959936fd304d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:37.834692 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6591bdc6-918e-414d-a76c-959936fd304d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:37.841151 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6591bdc6-918e-414d-a76c-959936fd304d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:37.841598 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6591bdc6-918e-414d-a76c-959936fd304d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:37.842346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6591bdc6-918e-414d-a76c-959936fd304d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:37.842798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6591bdc6-918e-414d-a76c-959936fd304d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:37.958200 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ec54c346-cd64-49c1-a3a0-f6757acc8e71 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:37.958966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ec54c346-cd64-49c1-a3a0-f6757acc8e71 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:37.965937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec54c346-cd64-49c1-a3a0-f6757acc8e71 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:37.966619 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec54c346-cd64-49c1-a3a0-f6757acc8e71 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:37.967173 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec54c346-cd64-49c1-a3a0-f6757acc8e71 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:37.967610 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec54c346-cd64-49c1-a3a0-f6757acc8e71 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:37.976954 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6591bdc6-918e-414d-a76c-959936fd304d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:37.984920 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6591bdc6-918e-414d-a76c-959936fd304d tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1367 microversion: 2.1 time: 0.155301 Jul 07 15:38:37.995176 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 353/707] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:37 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:38.097567 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ec54c346-cd64-49c1-a3a0-f6757acc8e71 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:38.104818 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ec54c346-cd64-49c1-a3a0-f6757acc8e71 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1362 microversion: 2.1 time: 0.150453 Jul 07 15:38:38.105379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 355/708] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:37 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:38.667061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-7b5db900-44cd-4a22-acfc-27a46856df9b req-1cd54374-c263-41c8-8bc7-212fb2d708cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1243dbb-87ee-43ac-8729-d18c53114d43", "name": "network-vif-plugged", "status": "completed", "tag": "2482ebe6-1259-4f2f-83d7-763ce7639812"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:38.670524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:38.676539 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-7b5db900-44cd-4a22-acfc-27a46856df9b req-1cd54374-c263-41c8-8bc7-212fb2d708cc service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:38.681042 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-7b5db900-44cd-4a22-acfc-27a46856df9b req-1cd54374-c263-41c8-8bc7-212fb2d708cc service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:38.687848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-7b5db900-44cd-4a22-acfc-27a46856df9b req-1cd54374-c263-41c8-8bc7-212fb2d708cc service nova] Creating event network-vif-plugged:2482ebe6-1259-4f2f-83d7-763ce7639812 for instance b1243dbb-87ee-43ac-8729-d18c53114d43 on hv-cinder-84130 Jul 07 15:38:38.693164 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-7b5db900-44cd-4a22-acfc-27a46856df9b req-1cd54374-c263-41c8-8bc7-212fb2d708cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029759 Jul 07 15:38:38.693740 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 354/709] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:39.003044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-457bda6a-9e55-454e-b8de-9562371b07f7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:39.003764 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-457bda6a-9e55-454e-b8de-9562371b07f7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:39.012058 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-457bda6a-9e55-454e-b8de-9562371b07f7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:39.012766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-457bda6a-9e55-454e-b8de-9562371b07f7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:39.014064 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-457bda6a-9e55-454e-b8de-9562371b07f7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:39.015169 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-457bda6a-9e55-454e-b8de-9562371b07f7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:39.124120 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e39dbf4c-4195-403a-8d8b-083930c10b5b tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:39.124719 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e39dbf4c-4195-403a-8d8b-083930c10b5b tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:39.131511 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e39dbf4c-4195-403a-8d8b-083930c10b5b tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:39.131986 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e39dbf4c-4195-403a-8d8b-083930c10b5b tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:39.132752 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e39dbf4c-4195-403a-8d8b-083930c10b5b tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:39.133186 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e39dbf4c-4195-403a-8d8b-083930c10b5b tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:39.157307 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-457bda6a-9e55-454e-b8de-9562371b07f7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:39.165765 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-457bda6a-9e55-454e-b8de-9562371b07f7 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1367 microversion: 2.1 time: 0.167322 Jul 07 15:38:39.166340 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 356/710] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:38 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:39.265752 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e39dbf4c-4195-403a-8d8b-083930c10b5b tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:39.274150 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e39dbf4c-4195-403a-8d8b-083930c10b5b tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1362 microversion: 2.1 time: 0.155467 Jul 07 15:38:39.274800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 355/711] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:39 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:40.182345 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8b65d2d8-a475-40e7-9202-864da4fb9c9f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:40.182946 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8b65d2d8-a475-40e7-9202-864da4fb9c9f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:40.184994 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:40.189720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8b65d2d8-a475-40e7-9202-864da4fb9c9f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:40.190163 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8b65d2d8-a475-40e7-9202-864da4fb9c9f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:40.190913 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8b65d2d8-a475-40e7-9202-864da4fb9c9f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:40.191343 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8b65d2d8-a475-40e7-9202-864da4fb9c9f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:40.291491 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f9706caf-462d-4745-82a1-89da8aec1879 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:40.292287 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f9706caf-462d-4745-82a1-89da8aec1879 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:40.298635 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9706caf-462d-4745-82a1-89da8aec1879 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:40.299083 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9706caf-462d-4745-82a1-89da8aec1879 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:40.299882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9706caf-462d-4745-82a1-89da8aec1879 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:40.300315 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9706caf-462d-4745-82a1-89da8aec1879 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:40.318641 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8b65d2d8-a475-40e7-9202-864da4fb9c9f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:40.326056 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8b65d2d8-a475-40e7-9202-864da4fb9c9f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1367 microversion: 2.1 time: 0.147741 Jul 07 15:38:40.326737 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 357/712] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:40 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:40.431151 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f9706caf-462d-4745-82a1-89da8aec1879 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:40.438574 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f9706caf-462d-4745-82a1-89da8aec1879 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1362 microversion: 2.1 time: 0.150979 Jul 07 15:38:40.439141 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 356/713] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:40 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:40.717738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-1d1c0dfd-7d83-4a7f-a50c-3c9f4787602a req-519ada6a-2e7a-4468-b228-dd87f03b1a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54a14c0-4b58-4edc-9325-b1c7da38307d", "name": "network-vif-plugged", "status": "completed", "tag": "8bf95f95-95f0-423b-b959-585f3cb8cc66"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:40.725892 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-1d1c0dfd-7d83-4a7f-a50c-3c9f4787602a req-519ada6a-2e7a-4468-b228-dd87f03b1a2a service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:40.726332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-1d1c0dfd-7d83-4a7f-a50c-3c9f4787602a req-519ada6a-2e7a-4468-b228-dd87f03b1a2a service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:40.741794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-1d1c0dfd-7d83-4a7f-a50c-3c9f4787602a req-519ada6a-2e7a-4468-b228-dd87f03b1a2a service nova] Creating event network-vif-plugged:8bf95f95-95f0-423b-b959-585f3cb8cc66 for instance e54a14c0-4b58-4edc-9325-b1c7da38307d on hv-cinder-84130 Jul 07 15:38:40.743641 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-1d1c0dfd-7d83-4a7f-a50c-3c9f4787602a req-519ada6a-2e7a-4468-b228-dd87f03b1a2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029508 Jul 07 15:38:40.744475 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 358/714] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:41.343180 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-bd92796d-5b22-4b35-8005-010ab44bfcea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:41.343828 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-bd92796d-5b22-4b35-8005-010ab44bfcea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:41.346310 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=12 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:41.351487 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd92796d-5b22-4b35-8005-010ab44bfcea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:41.351956 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd92796d-5b22-4b35-8005-010ab44bfcea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:41.352744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd92796d-5b22-4b35-8005-010ab44bfcea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:41.353169 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd92796d-5b22-4b35-8005-010ab44bfcea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:41.357072 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:41.456098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5c855323-a0b7-4239-9da7-5e5504343797 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:41.456811 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5c855323-a0b7-4239-9da7-5e5504343797 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:41.459789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:41.460517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=12 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:41.464594 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c855323-a0b7-4239-9da7-5e5504343797 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:41.465037 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c855323-a0b7-4239-9da7-5e5504343797 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:41.465797 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c855323-a0b7-4239-9da7-5e5504343797 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:41.466358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c855323-a0b7-4239-9da7-5e5504343797 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:41.482512 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-bd92796d-5b22-4b35-8005-010ab44bfcea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:41.490671 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-bd92796d-5b22-4b35-8005-010ab44bfcea tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1367 microversion: 2.1 time: 0.151339 Jul 07 15:38:41.491238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 357/715] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:41 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:41.599167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5c855323-a0b7-4239-9da7-5e5504343797 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:41.601309 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:38:41.607061 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5c855323-a0b7-4239-9da7-5e5504343797 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1547 microversion: 2.1 time: 0.155393 Jul 07 15:38:41.607646 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 359/716] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:41 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:41.625476 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-490ae0d3-7bee-4a7a-8e6b-be56ac3f3306 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:41.625963 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-490ae0d3-7bee-4a7a-8e6b-be56ac3f3306 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:41.632260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-490ae0d3-7bee-4a7a-8e6b-be56ac3f3306 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:41.632691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-490ae0d3-7bee-4a7a-8e6b-be56ac3f3306 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:41.635112 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-490ae0d3-7bee-4a7a-8e6b-be56ac3f3306 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:41.635112 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-490ae0d3-7bee-4a7a-8e6b-be56ac3f3306 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:41.710999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-490ae0d3-7bee-4a7a-8e6b-be56ac3f3306 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089715 Jul 07 15:38:41.711605 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 358/717] 10.222.0.25 () {58 vars in 1274 bytes} [Thu Jul 7 15:38:41 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:42.508297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0533b184-bcb3-4193-adc4-ea6154ccd65a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:42.508831 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0533b184-bcb3-4193-adc4-ea6154ccd65a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:42.516157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0533b184-bcb3-4193-adc4-ea6154ccd65a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:42.516604 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0533b184-bcb3-4193-adc4-ea6154ccd65a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:42.517369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0533b184-bcb3-4193-adc4-ea6154ccd65a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:42.517801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0533b184-bcb3-4193-adc4-ea6154ccd65a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:42.723890 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0533b184-bcb3-4193-adc4-ea6154ccd65a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:42.732893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0533b184-bcb3-4193-adc4-ea6154ccd65a tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1367 microversion: 2.1 time: 0.228700 Jul 07 15:38:42.733936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 360/718] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:42 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:42.776639 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-6e0e9552-7d86-4584-81d4-cf531b8109d0 req-1c7e14c0-538d-414f-b0de-53d682860572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1243dbb-87ee-43ac-8729-d18c53114d43", "tag": "2482ebe6-1259-4f2f-83d7-763ce7639812"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:42.785391 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-6e0e9552-7d86-4584-81d4-cf531b8109d0 req-1c7e14c0-538d-414f-b0de-53d682860572 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:42.785842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-6e0e9552-7d86-4584-81d4-cf531b8109d0 req-1c7e14c0-538d-414f-b0de-53d682860572 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:42.797753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-6e0e9552-7d86-4584-81d4-cf531b8109d0 req-1c7e14c0-538d-414f-b0de-53d682860572 service nova] Creating event network-changed:2482ebe6-1259-4f2f-83d7-763ce7639812 for instance b1243dbb-87ee-43ac-8729-d18c53114d43 on hv-cinder-84130 Jul 07 15:38:42.803422 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-6e0e9552-7d86-4584-81d4-cf531b8109d0 req-1c7e14c0-538d-414f-b0de-53d682860572 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031616 Jul 07 15:38:42.804268 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 359/719] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:43.750166 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-34f1b248-0ca2-4995-8dd3-045ee2971248 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:43.750919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-34f1b248-0ca2-4995-8dd3-045ee2971248 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:43.757970 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-34f1b248-0ca2-4995-8dd3-045ee2971248 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:43.758476 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-34f1b248-0ca2-4995-8dd3-045ee2971248 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:43.759216 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-34f1b248-0ca2-4995-8dd3-045ee2971248 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:43.759677 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-34f1b248-0ca2-4995-8dd3-045ee2971248 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:43.891514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-34f1b248-0ca2-4995-8dd3-045ee2971248 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:43.898991 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-34f1b248-0ca2-4995-8dd3-045ee2971248 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1556 microversion: 2.1 time: 0.152672 Jul 07 15:38:43.899554 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 361/720] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:43 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:43.918530 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-496ffe81-3f40-4a73-ad40-8905f879e656 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:43.919104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-496ffe81-3f40-4a73-ad40-8905f879e656 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:43.925827 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-496ffe81-3f40-4a73-ad40-8905f879e656 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:43.926783 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-496ffe81-3f40-4a73-ad40-8905f879e656 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:43.927105 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-496ffe81-3f40-4a73-ad40-8905f879e656 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:43.927476 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-496ffe81-3f40-4a73-ad40-8905f879e656 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:44.007380 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-496ffe81-3f40-4a73-ad40-8905f879e656 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093479 Jul 07 15:38:44.008050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 360/721] 10.222.0.25 () {58 vars in 1274 bytes} [Thu Jul 7 15:38:43 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:45.253076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-7e2dc1a8-d6ca-4b30-b577-59e11d8d7780 req-41ad8fff-294d-43a3-aa5a-f1ed9a2f6745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54a14c0-4b58-4edc-9325-b1c7da38307d", "tag": "8bf95f95-95f0-423b-b959-585f3cb8cc66"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:45.261330 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-7e2dc1a8-d6ca-4b30-b577-59e11d8d7780 req-41ad8fff-294d-43a3-aa5a-f1ed9a2f6745 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:45.261772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-7e2dc1a8-d6ca-4b30-b577-59e11d8d7780 req-41ad8fff-294d-43a3-aa5a-f1ed9a2f6745 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:45.272987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-7e2dc1a8-d6ca-4b30-b577-59e11d8d7780 req-41ad8fff-294d-43a3-aa5a-f1ed9a2f6745 service nova] Creating event network-changed:8bf95f95-95f0-423b-b959-585f3cb8cc66 for instance e54a14c0-4b58-4edc-9325-b1c7da38307d on hv-cinder-84130 Jul 07 15:38:45.277738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-7e2dc1a8-d6ca-4b30-b577-59e11d8d7780 req-41ad8fff-294d-43a3-aa5a-f1ed9a2f6745 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087900 Jul 07 15:38:45.278320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 362/722] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:47.259772 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7e715113-1791-4323-bfb7-a64a995e1355 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:47.260249 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7e715113-1791-4323-bfb7-a64a995e1355 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:47.266224 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e715113-1791-4323-bfb7-a64a995e1355 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:47.266671 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e715113-1791-4323-bfb7-a64a995e1355 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:47.267424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e715113-1791-4323-bfb7-a64a995e1355 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:47.267883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e715113-1791-4323-bfb7-a64a995e1355 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:47.346306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-7e715113-1791-4323-bfb7-a64a995e1355 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lazy-loading 'services' on Instance uuid 05028730-a81d-4edf-a4e2-96d672547be4 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:38:47.558319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7e715113-1791-4323-bfb7-a64a995e1355 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments/f60f9783-29f4-4af0-933a-ac6fd64f3b7d" status: 202 len: 0 microversion: 2.1 time: 0.302819 Jul 07 15:38:47.558967 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 361/723] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:38:47 2022] DELETE /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments/f60f9783-29f4-4af0-933a-ac6fd64f3b7d => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:38:47.569093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fcb8aa99-6a82-45d5-8ac4-d2c93aad0ce5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:47.570137 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fcb8aa99-6a82-45d5-8ac4-d2c93aad0ce5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:47.576445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcb8aa99-6a82-45d5-8ac4-d2c93aad0ce5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:47.576865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcb8aa99-6a82-45d5-8ac4-d2c93aad0ce5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:47.577617 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcb8aa99-6a82-45d5-8ac4-d2c93aad0ce5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:47.578041 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcb8aa99-6a82-45d5-8ac4-d2c93aad0ce5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:47.609007 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fcb8aa99-6a82-45d5-8ac4-d2c93aad0ce5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Jul 07 15:38:47.609555 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 363/724] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:38:47 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:48.622781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0d606fd3-23f3-4fb7-9adf-08eeadf78050 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:48.623945 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0d606fd3-23f3-4fb7-9adf-08eeadf78050 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:48.630427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0d606fd3-23f3-4fb7-9adf-08eeadf78050 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:48.630881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0d606fd3-23f3-4fb7-9adf-08eeadf78050 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:48.631700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0d606fd3-23f3-4fb7-9adf-08eeadf78050 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:48.632134 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0d606fd3-23f3-4fb7-9adf-08eeadf78050 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:48.662120 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0d606fd3-23f3-4fb7-9adf-08eeadf78050 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Jul 07 15:38:48.662671 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 362/725] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:38:48 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:49.674345 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6b48aa1b-83e6-45ab-a8fc-6947124746e5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:49.675244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6b48aa1b-83e6-45ab-a8fc-6947124746e5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:49.681672 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6b48aa1b-83e6-45ab-a8fc-6947124746e5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:49.682108 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6b48aa1b-83e6-45ab-a8fc-6947124746e5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:49.682848 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6b48aa1b-83e6-45ab-a8fc-6947124746e5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:49.683278 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6b48aa1b-83e6-45ab-a8fc-6947124746e5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:49.711402 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6b48aa1b-83e6-45ab-a8fc-6947124746e5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041078 Jul 07 15:38:49.711977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 364/726] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:38:49 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:38:49.780606 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-71dc1c13-d6a9-4699-a417-bee97eca4fe8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:49.781116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-71dc1c13-d6a9-4699-a417-bee97eca4fe8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:49.787557 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-71dc1c13-d6a9-4699-a417-bee97eca4fe8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:49.788031 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-71dc1c13-d6a9-4699-a417-bee97eca4fe8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:49.788785 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-71dc1c13-d6a9-4699-a417-bee97eca4fe8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:49.789216 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-71dc1c13-d6a9-4699-a417-bee97eca4fe8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:49.813328 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-71dc1c13-d6a9-4699-a417-bee97eca4fe8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Going to try to terminate instance {{(pid=124720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:38:49.919872 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9c473b15-5c20-436e-976a-a9ab5acf0532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:49.920354 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9c473b15-5c20-436e-976a-a9ab5acf0532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:49.926846 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9c473b15-5c20-436e-976a-a9ab5acf0532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:49.927222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9c473b15-5c20-436e-976a-a9ab5acf0532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:49.927996 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9c473b15-5c20-436e-976a-a9ab5acf0532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:49.928424 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9c473b15-5c20-436e-976a-a9ab5acf0532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:49.951453 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9c473b15-5c20-436e-976a-a9ab5acf0532 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/ips" status: 200 len: 152 microversion: 2.20 time: 0.083099 Jul 07 15:38:49.952107 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 365/727] 10.222.0.25 () {60 vars in 1288 bytes} [Thu Jul 7 15:38:49 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/ips => generated 152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 15:38:50.109198 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-71dc1c13-d6a9-4699-a417-bee97eca4fe8 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 204 len: 0 microversion: 2.1 time: 0.331989 Jul 07 15:38:50.109782 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 363/728] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:38:49 2022] DELETE /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:38:50.118384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2e6477ca-f64a-4cd9-a599-5ccdb6bfd4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:50.119048 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2e6477ca-f64a-4cd9-a599-5ccdb6bfd4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:50.125345 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e6477ca-f64a-4cd9-a599-5ccdb6bfd4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:50.125798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e6477ca-f64a-4cd9-a599-5ccdb6bfd4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:50.126616 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e6477ca-f64a-4cd9-a599-5ccdb6bfd4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:50.127707 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e6477ca-f64a-4cd9-a599-5ccdb6bfd4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:50.262718 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2e6477ca-f64a-4cd9-a599-5ccdb6bfd4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:50.270485 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2e6477ca-f64a-4cd9-a599-5ccdb6bfd4b1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1689 microversion: 2.1 time: 0.155974 Jul 07 15:38:50.271055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 366/729] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:50 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:51.288709 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f9a413a5-4e8b-4022-92ca-7548f8bb50e2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:51.289345 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f9a413a5-4e8b-4022-92ca-7548f8bb50e2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:51.295806 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9a413a5-4e8b-4022-92ca-7548f8bb50e2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:51.296288 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9a413a5-4e8b-4022-92ca-7548f8bb50e2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:51.297047 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9a413a5-4e8b-4022-92ca-7548f8bb50e2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:51.297475 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f9a413a5-4e8b-4022-92ca-7548f8bb50e2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:51.426676 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f9a413a5-4e8b-4022-92ca-7548f8bb50e2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:51.434490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f9a413a5-4e8b-4022-92ca-7548f8bb50e2 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1689 microversion: 2.1 time: 0.150133 Jul 07 15:38:51.435136 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 364/730] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:51 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:52.116220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0abec7b6-f3c7-4c80-8b90-8db1c1b4a58c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:52.116749 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0abec7b6-f3c7-4c80-8b90-8db1c1b4a58c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:52.123263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0abec7b6-f3c7-4c80-8b90-8db1c1b4a58c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:52.123743 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0abec7b6-f3c7-4c80-8b90-8db1c1b4a58c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:52.124498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0abec7b6-f3c7-4c80-8b90-8db1c1b4a58c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:52.124930 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0abec7b6-f3c7-4c80-8b90-8db1c1b4a58c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:52.148947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-0abec7b6-f3c7-4c80-8b90-8db1c1b4a58c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lazy-loading 'flavor' on Instance uuid d8cfd6f9-be72-41c0-8887-1425b3f5565c {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:38:52.451381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-dc3cdfca-e3cf-4825-999d-22571997334c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:52.452052 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-dc3cdfca-e3cf-4825-999d-22571997334c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:52.458720 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dc3cdfca-e3cf-4825-999d-22571997334c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:52.459162 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dc3cdfca-e3cf-4825-999d-22571997334c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:52.459939 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dc3cdfca-e3cf-4825-999d-22571997334c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:52.460367 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dc3cdfca-e3cf-4825-999d-22571997334c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:52.593578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-dc3cdfca-e3cf-4825-999d-22571997334c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:52.601497 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-dc3cdfca-e3cf-4825-999d-22571997334c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1689 microversion: 2.1 time: 0.154055 Jul 07 15:38:52.602084 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 365/731] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:52 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:38:52.805609 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0abec7b6-f3c7-4c80-8b90-8db1c1b4a58c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/action" status: 202 len: 0 microversion: 2.20 time: 0.693107 Jul 07 15:38:52.809945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 367/732] 10.222.0.25 () {62 vars in 1318 bytes} [Thu Jul 7 15:38:52 2022] POST /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:38:52.814323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:52.814929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:52.821060 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:52.821508 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:52.822264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:52.822685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:52.952248 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:52.960632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:52.962125 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:52.963262 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-af18556f-1dc6-4ada-9eae-91b0c90c6e03 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.152816 Jul 07 15:38:52.963842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 366/733] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:52 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:53.619295 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4800e5bd-50f7-46ab-a713-f8edd110a6e1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:53.620013 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4800e5bd-50f7-46ab-a713-f8edd110a6e1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:53.626242 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4800e5bd-50f7-46ab-a713-f8edd110a6e1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:53.627298 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4800e5bd-50f7-46ab-a713-f8edd110a6e1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:53.628078 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4800e5bd-50f7-46ab-a713-f8edd110a6e1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:53.628508 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4800e5bd-50f7-46ab-a713-f8edd110a6e1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:53.762276 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4800e5bd-50f7-46ab-a713-f8edd110a6e1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:53.770304 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4800e5bd-50f7-46ab-a713-f8edd110a6e1 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1689 microversion: 2.1 time: 0.155592 Jul 07 15:38:53.770886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 368/734] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:53 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:53.981210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:53.981819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:53.989251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:53.989711 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:53.990470 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:53.990903 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:54.118569 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:54.126659 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:54.128197 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:54.129350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-212d2237-4a5f-404e-ba80-6954c5b0d1b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.152071 Jul 07 15:38:54.129904 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 367/735] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:53 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:54.589682 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-7961e663-a889-4d84-9f1e-68e94c86bf90 req-f6eb4d66-26ac-4146-b767-ca765ef79f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05028730-a81d-4edf-a4e2-96d672547be4", "name": "network-vif-deleted", "tag": "1b1ff111-abae-4beb-8edb-da235fcc08f4"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:38:54.600328 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-7961e663-a889-4d84-9f1e-68e94c86bf90 req-f6eb4d66-26ac-4146-b767-ca765ef79f7d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:54.600328 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-7961e663-a889-4d84-9f1e-68e94c86bf90 req-f6eb4d66-26ac-4146-b767-ca765ef79f7d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:54.609240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-7961e663-a889-4d84-9f1e-68e94c86bf90 req-f6eb4d66-26ac-4146-b767-ca765ef79f7d service nova] Creating event network-vif-deleted:1b1ff111-abae-4beb-8edb-da235fcc08f4 for instance 05028730-a81d-4edf-a4e2-96d672547be4 on hv-cinder-84130 Jul 07 15:38:54.614736 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-7961e663-a889-4d84-9f1e-68e94c86bf90 req-f6eb4d66-26ac-4146-b767-ca765ef79f7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029189 Jul 07 15:38:54.615295 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 369/736] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:38:54.789999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6df3a527-85d1-403c-a807-af8d0b2fa225 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:54.791062 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6df3a527-85d1-403c-a807-af8d0b2fa225 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:54.804613 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6df3a527-85d1-403c-a807-af8d0b2fa225 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:54.805058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6df3a527-85d1-403c-a807-af8d0b2fa225 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:54.805835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6df3a527-85d1-403c-a807-af8d0b2fa225 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:54.806267 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6df3a527-85d1-403c-a807-af8d0b2fa225 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:54.873263 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6df3a527-85d1-403c-a807-af8d0b2fa225 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:54.880959 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6df3a527-85d1-403c-a807-af8d0b2fa225 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 200 len: 1330 microversion: 2.1 time: 0.095111 Jul 07 15:38:54.881854 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 368/737] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:54 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:55.150122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:55.150883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:55.157290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:55.157819 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:55.159343 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:55.159959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:55.300453 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:55.314340 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:55.315885 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:55.317072 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-180f9758-e486-41a0-8733-2539df2ba506 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.171706 Jul 07 15:38:55.317809 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 370/738] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:55 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:55.897623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:55.898230 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 05028730-a81d-4edf-a4e2-96d672547be4] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:55.904706 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:55.905092 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:55.905841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:55.906271 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:55.919319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] HTTP exception thrown: Instance 05028730-a81d-4edf-a4e2-96d672547be4 could not be found. Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Request method failure captured: Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 HTTP/1.1 Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv0JGRXksEBbg0w67HlozL4VW71_ag0hzYbFjCOPe6-Dn4Q6sXAn89l0RxBVWxsLjAvIZwxa2fxfqxK4Ew1N4hRqwmjkN9YjOWMCW1veSaiKYUxr1SaVGN6D8bsYtVz94rH8MgMnXHNMOQ3twr-mW9qa-5kmlnf94Q0d0eQvaqgapjM Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:38:55.920944 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8404651e9fb4443a9cdebb3f79a4e6a8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 9528a9a3306d49b0978d77d1ce1ca900 Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 05028730-a81d-4edf-a4e2-96d672547be4 could not be found. Jul 07 15:38:55.922538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '05028730-a81d-4edf-a4e2-96d672547be4'} Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05028730-a81d-4edf-a4e2-96d672547be4 could not be found. Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:38:55.923425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05028730-a81d-4edf-a4e2-96d672547be4 could not be found. Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05028730-a81d-4edf-a4e2-96d672547be4 could not be found. Jul 07 15:38:55.925498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:38:55.926814 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Returning 404 to user: Instance 05028730-a81d-4edf-a4e2-96d672547be4 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:38:55.926814 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-41f48a17-5b47-4496-9a5b-a932fb69c3af tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4" status: 404 len: 111 microversion: 2.1 time: 0.028573 Jul 07 15:38:55.926814 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 369/739] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:55 2022] GET /compute/v2.1/servers/05028730-a81d-4edf-a4e2-96d672547be4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:38:55.931434 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d57453c8-7888-48ae-8d0c-82a2b0234a07 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '.version_select at 0x7f524971e9d0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:56.041060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d57453c8-7888-48ae-8d0c-82a2b0234a07 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187242409" status: 202 len: 0 microversion: 2.1 time: 0.113419 Jul 07 15:38:56.041636 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 371/740] 10.222.0.25 () {58 vars in 1220 bytes} [Thu Jul 7 15:38:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187242409 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:38:56.335425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:56.336155 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:56.342190 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:56.342634 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:56.343394 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:56.343853 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:56.478718 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:56.485326 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:56.487410 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:56.488584 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7e570566-c847-4f8b-86b4-065a338f2f17 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.157157 Jul 07 15:38:56.489176 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 370/741] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:56 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:57.507225 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:57.507853 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:57.516410 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:57.516848 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:57.517624 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:57.518050 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:57.643698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:57.651534 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:57.653041 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:57.654171 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-eeab90ef-03c7-4f00-aaee-9d0ea14b45c3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.151590 Jul 07 15:38:57.654718 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 372/742] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:57 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:58.672631 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:58.673236 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:58.680191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:58.680603 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:58.681369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:58.681803 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:58.810140 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:58.818459 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:58.819981 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:58.821119 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fde17c32-8630-442d-8b94-007183359ac3 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.152439 Jul 07 15:38:58.821676 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 371/743] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:58 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:38:59.203267 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6402ba51-d973-4b28-ba2e-90c468ba489c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:59.203773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6402ba51-d973-4b28-ba2e-90c468ba489c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:59.210133 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6402ba51-d973-4b28-ba2e-90c468ba489c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:59.210578 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6402ba51-d973-4b28-ba2e-90c468ba489c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:59.211331 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6402ba51-d973-4b28-ba2e-90c468ba489c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:59.211803 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6402ba51-d973-4b28-ba2e-90c468ba489c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:59.237126 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6402ba51-d973-4b28-ba2e-90c468ba489c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:38:59.491681 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6402ba51-d973-4b28-ba2e-90c468ba489c tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 204 len: 0 microversion: 2.1 time: 0.291761 Jul 07 15:38:59.492279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 373/744] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:38:59 2022] DELETE /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:38:59.500204 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3a4c7a32-8212-4015-8f48-6797e8f4ef1b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:59.500819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3a4c7a32-8212-4015-8f48-6797e8f4ef1b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:59.507546 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a4c7a32-8212-4015-8f48-6797e8f4ef1b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:59.513149 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a4c7a32-8212-4015-8f48-6797e8f4ef1b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:59.513149 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a4c7a32-8212-4015-8f48-6797e8f4ef1b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:59.513149 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a4c7a32-8212-4015-8f48-6797e8f4ef1b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:59.639585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3a4c7a32-8212-4015-8f48-6797e8f4ef1b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:59.647345 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3a4c7a32-8212-4015-8f48-6797e8f4ef1b tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1505 microversion: 2.1 time: 0.151049 Jul 07 15:38:59.647933 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 372/745] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:38:59 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:38:59.840066 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:38:59.840758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:38:59.846710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:59.850720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:59.850720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:38:59.850720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:38:59.978206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:59.987222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:59.988771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:38:59.989898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-64628760-7a09-4f26-af87-440003105cf0 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.154078 Jul 07 15:38:59.990448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 374/746] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:38:59 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:00.664916 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cd6304f8-4f0d-4eed-8e0f-6bfc955a28b7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:00.665520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cd6304f8-4f0d-4eed-8e0f-6bfc955a28b7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:00.672128 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd6304f8-4f0d-4eed-8e0f-6bfc955a28b7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:00.672574 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd6304f8-4f0d-4eed-8e0f-6bfc955a28b7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:00.673334 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd6304f8-4f0d-4eed-8e0f-6bfc955a28b7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:00.673875 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd6304f8-4f0d-4eed-8e0f-6bfc955a28b7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:00.691795 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:00.805603 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cd6304f8-4f0d-4eed-8e0f-6bfc955a28b7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:00.813893 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cd6304f8-4f0d-4eed-8e0f-6bfc955a28b7 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1505 microversion: 2.1 time: 0.152736 Jul 07 15:39:00.815077 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 373/747] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:00 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:01.008114 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:01.008722 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:01.015153 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:01.015697 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:01.016460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:01.016896 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:01.031621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:01.149985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:01.157674 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:01.159791 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:01.160924 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-59967779-26dd-4019-a067-976e617177fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.156785 Jul 07 15:39:01.161478 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 375/748] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:01 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:01.831619 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-088d7ab2-7b5e-4c7f-84a2-fe40f9acdf3d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:01.832235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-088d7ab2-7b5e-4c7f-84a2-fe40f9acdf3d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:01.838740 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-088d7ab2-7b5e-4c7f-84a2-fe40f9acdf3d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:01.839188 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-088d7ab2-7b5e-4c7f-84a2-fe40f9acdf3d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:01.839972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-088d7ab2-7b5e-4c7f-84a2-fe40f9acdf3d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:01.840406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-088d7ab2-7b5e-4c7f-84a2-fe40f9acdf3d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:01.972888 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-088d7ab2-7b5e-4c7f-84a2-fe40f9acdf3d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:01.980520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-088d7ab2-7b5e-4c7f-84a2-fe40f9acdf3d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1505 microversion: 2.1 time: 0.152835 Jul 07 15:39:01.981086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 374/749] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:01 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:02.178312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:02.178898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:02.185351 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:02.185788 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:02.186538 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:02.186961 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:02.314295 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:02.322717 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:02.324246 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:02.325370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-50b098ab-e3f2-4a68-a2f5-ffebd861dcef tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.150961 Jul 07 15:39:02.325923 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 376/750] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:02 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:02.429277 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-4c68be5a-d02b-4c4f-9956-44f8dfd72724 req-874f6c3e-c084-4713-9563-d0c9dcbaa7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f6716b-a8c3-4705-8a18-390af053ad3b", "name": "network-vif-deleted", "tag": "3537eab4-d5c1-44c3-af6a-0429074eef9e"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:02.437233 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-4c68be5a-d02b-4c4f-9956-44f8dfd72724 req-874f6c3e-c084-4713-9563-d0c9dcbaa7cd service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:02.437679 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-4c68be5a-d02b-4c4f-9956-44f8dfd72724 req-874f6c3e-c084-4713-9563-d0c9dcbaa7cd service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:02.449335 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-4c68be5a-d02b-4c4f-9956-44f8dfd72724 req-874f6c3e-c084-4713-9563-d0c9dcbaa7cd service nova] Creating event network-vif-deleted:3537eab4-d5c1-44c3-af6a-0429074eef9e for instance e3f6716b-a8c3-4705-8a18-390af053ad3b on hv-cinder-84130 Jul 07 15:39:02.454147 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-4c68be5a-d02b-4c4f-9956-44f8dfd72724 req-874f6c3e-c084-4713-9563-d0c9dcbaa7cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028592 Jul 07 15:39:02.454778 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 375/751] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:02.997604 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:02.998229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:03.004421 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:03.004860 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:03.005606 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:03.006031 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:03.039533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:03.039999 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:03.040432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lazy-loading 'fault' on Instance uuid e3f6716b-a8c3-4705-8a18-390af053ad3b {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:39:03.081578 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:03.088743 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8c5201c6-b3e6-4ab5-b112-2ffc4d296ca5 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 200 len: 1311 microversion: 2.1 time: 0.094967 Jul 07 15:39:03.089332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 377/752] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:02 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:03.345978 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:03.346775 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:03.348743 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:03.353999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:03.354450 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:03.355212 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:03.355672 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:03.495019 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:03.503653 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:03.505164 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:03.506319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d89cfd02-b57d-4631-85f7-dc72946d37b7 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.166037 Jul 07 15:39:03.506884 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 376/753] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:03 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:04.105483 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:04.106084 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: e3f6716b-a8c3-4705-8a18-390af053ad3b] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:04.113441 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:04.113880 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:04.114628 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:04.115052 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:04.128467 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] HTTP exception thrown: Instance e3f6716b-a8c3-4705-8a18-390af053ad3b could not be found. Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Request method failure captured: Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b HTTP/1.1 Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv0JGRXksEBbg0w67HlozL4VW71_ag0hzYbFjCOPe6-Dn4Q6sXAn89l0RxBVWxsLjAvIZwxa2fxfqxK4Ew1N4hRqwmjkN9YjOWMCW1veSaiKYUxr1SaVGN6D8bsYtVz94rH8MgMnXHNMOQ3twr-mW9qa-5kmlnf94Q0d0eQvaqgapjM Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:39:04.130042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8404651e9fb4443a9cdebb3f79a4e6a8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 9528a9a3306d49b0978d77d1ce1ca900 Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance e3f6716b-a8c3-4705-8a18-390af053ad3b could not be found. Jul 07 15:39:04.131548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'e3f6716b-a8c3-4705-8a18-390af053ad3b'} Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f6716b-a8c3-4705-8a18-390af053ad3b could not be found. Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:39:04.132486 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f6716b-a8c3-4705-8a18-390af053ad3b could not be found. Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f6716b-a8c3-4705-8a18-390af053ad3b could not be found. Jul 07 15:39:04.133973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:04.135480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Returning 404 to user: Instance e3f6716b-a8c3-4705-8a18-390af053ad3b could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:39:04.135480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-be110edd-8d84-42a0-8f6e-339051131678 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b" status: 404 len: 111 microversion: 2.1 time: 0.029791 Jul 07 15:39:04.135480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 378/754] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:04 2022] GET /compute/v2.1/servers/e3f6716b-a8c3-4705-8a18-390af053ad3b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:39:04.139592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-85db0ed6-0759-46ce-80ad-998cc6d58698 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:04.140081 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-85db0ed6-0759-46ce-80ad-998cc6d58698 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:04.146283 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-85db0ed6-0759-46ce-80ad-998cc6d58698 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:04.146732 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-85db0ed6-0759-46ce-80ad-998cc6d58698 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:04.147492 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-85db0ed6-0759-46ce-80ad-998cc6d58698 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:04.147962 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-85db0ed6-0759-46ce-80ad-998cc6d58698 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:04.171675 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-85db0ed6-0759-46ce-80ad-998cc6d58698 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Going to try to terminate instance {{(pid=124720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:39:04.439507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-85db0ed6-0759-46ce-80ad-998cc6d58698 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 204 len: 0 microversion: 2.1 time: 0.303245 Jul 07 15:39:04.440781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 377/755] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:39:04 2022] DELETE /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:39:04.448767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-98851f78-6d1c-4c1f-a452-1595ce245f69 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:04.449395 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-98851f78-6d1c-4c1f-a452-1595ce245f69 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:04.455804 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-98851f78-6d1c-4c1f-a452-1595ce245f69 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:04.456245 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-98851f78-6d1c-4c1f-a452-1595ce245f69 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:04.457010 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-98851f78-6d1c-4c1f-a452-1595ce245f69 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:04.457418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-98851f78-6d1c-4c1f-a452-1595ce245f69 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:04.524863 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:04.525556 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:04.531703 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:04.532155 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:04.532919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:04.533868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:04.616382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-98851f78-6d1c-4c1f-a452-1595ce245f69 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:04.623935 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-98851f78-6d1c-4c1f-a452-1595ce245f69 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.178923 Jul 07 15:39:04.624583 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 379/756] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:04 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:04.677687 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:04.685579 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:04.687099 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:04.688279 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f5aaf323-4428-47cd-9d7c-7b3a20fe9732 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.167692 Jul 07 15:39:04.688834 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 378/757] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:04 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:05.641083 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-37e7ba11-a2f3-422d-8d02-b70e9d9533de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:05.641687 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-37e7ba11-a2f3-422d-8d02-b70e9d9533de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:05.648683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-37e7ba11-a2f3-422d-8d02-b70e9d9533de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:05.649124 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-37e7ba11-a2f3-422d-8d02-b70e9d9533de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:05.649870 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-37e7ba11-a2f3-422d-8d02-b70e9d9533de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:05.650298 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-37e7ba11-a2f3-422d-8d02-b70e9d9533de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:05.706636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:05.707252 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:05.713703 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:05.714149 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:05.714907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:05.715338 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:05.818562 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-37e7ba11-a2f3-422d-8d02-b70e9d9533de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:05.826025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-37e7ba11-a2f3-422d-8d02-b70e9d9533de tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.188794 Jul 07 15:39:05.826595 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 380/758] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:05 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:05.862822 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:05.870655 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:05.872236 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:05.873358 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6c6d9ea6-ef23-483d-afac-c6e1c8e053af tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.171122 Jul 07 15:39:05.873906 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 379/759] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:05 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:06.843819 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9b9501da-d9da-450a-a11d-6f83f541249a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:06.844425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9b9501da-d9da-450a-a11d-6f83f541249a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:06.851397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b9501da-d9da-450a-a11d-6f83f541249a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:06.851913 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b9501da-d9da-450a-a11d-6f83f541249a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:06.852665 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b9501da-d9da-450a-a11d-6f83f541249a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:06.853100 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b9501da-d9da-450a-a11d-6f83f541249a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:06.891297 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:06.891936 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:06.898437 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:06.898876 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:06.899654 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:06.900080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:07.033929 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9b9501da-d9da-450a-a11d-6f83f541249a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:07.041318 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9b9501da-d9da-450a-a11d-6f83f541249a tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.201312 Jul 07 15:39:07.041897 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 381/760] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:06 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:07.059600 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:07.068210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:07.069701 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:07.070839 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6a7e30c8-36f3-4e18-85ed-ac49445c8be4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.183377 Jul 07 15:39:07.071382 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 380/761] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:06 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:08.058129 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6da8c227-8c96-470c-a2fb-e5cdb2ac682d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:08.058726 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6da8c227-8c96-470c-a2fb-e5cdb2ac682d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:08.065146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6da8c227-8c96-470c-a2fb-e5cdb2ac682d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:08.065589 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6da8c227-8c96-470c-a2fb-e5cdb2ac682d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:08.066360 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6da8c227-8c96-470c-a2fb-e5cdb2ac682d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:08.066787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6da8c227-8c96-470c-a2fb-e5cdb2ac682d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:08.088831 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:08.089435 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:08.096449 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:08.096897 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:08.097662 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:08.098091 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:08.277120 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6da8c227-8c96-470c-a2fb-e5cdb2ac682d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:08.285258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:08.286826 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6da8c227-8c96-470c-a2fb-e5cdb2ac682d tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1521 microversion: 2.1 time: 0.232435 Jul 07 15:39:08.296452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 382/762] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:08 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:08.297090 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:08.298604 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:08.299836 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9f6ae710-27f5-45db-b2bc-08e0ce04ad7c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.214944 Jul 07 15:39:08.300391 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 381/763] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:08 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:08.699312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-2488433f-1f2e-43b1-adcf-807949c9e8c0 req-39a83f33-a085-4fa9-963f-5e9a50a13cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c2472d-0015-49d1-ab4c-7eb597cbaa69", "name": "network-vif-deleted", "tag": "3d9501ce-92dd-42ac-aa7f-f93d92682896"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:08.707397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-2488433f-1f2e-43b1-adcf-807949c9e8c0 req-39a83f33-a085-4fa9-963f-5e9a50a13cbf service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:08.708829 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-2488433f-1f2e-43b1-adcf-807949c9e8c0 req-39a83f33-a085-4fa9-963f-5e9a50a13cbf service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:08.718706 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-2488433f-1f2e-43b1-adcf-807949c9e8c0 req-39a83f33-a085-4fa9-963f-5e9a50a13cbf service nova] Creating event network-vif-deleted:3d9501ce-92dd-42ac-aa7f-f93d92682896 for instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 on hv-cinder-84130 Jul 07 15:39:08.723714 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-2488433f-1f2e-43b1-adcf-807949c9e8c0 req-39a83f33-a085-4fa9-963f-5e9a50a13cbf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028023 Jul 07 15:39:08.724297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 383/764] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:09.304286 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:09.304825 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:09.311205 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:09.312528 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:09.312528 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:09.312861 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:09.321358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:09.322520 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:09.329540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:09.330570 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:09.331702 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:09.332144 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:09.346663 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:09.347112 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:09.347552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lazy-loading 'fault' on Instance uuid 73c2472d-0015-49d1-ab4c-7eb597cbaa69 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:39:09.415390 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9528a9a3306d49b0978d77d1ce1ca900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8404651e9fb4443a9cdebb3f79a4e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:09.422821 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-07ad801f-adb2-4f68-8ae3-a243e31e5ce3 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 200 len: 1312 microversion: 2.1 time: 0.122480 Jul 07 15:39:09.423392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 382/765] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:09 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:09.482430 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:09.491540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:09.493118 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:09.494271 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5c7edb0f-7bde-4d3c-bbef-5ee9e62429a4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1743 microversion: 2.20 time: 0.180155 Jul 07 15:39:09.494828 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 384/766] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:09 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:10.440826 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:10.441444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] [instance: 73c2472d-0015-49d1-ab4c-7eb597cbaa69] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:10.448017 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:10.460976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:10.460976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:10.460976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:10.462460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] HTTP exception thrown: Instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 could not be found. Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Request method failure captured: Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 HTTP/1.1 Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv0JGRXksEBbg0w67HlozL4VW71_ag0hzYbFjCOPe6-Dn4Q6sXAn89l0RxBVWxsLjAvIZwxa2fxfqxK4Ew1N4hRqwmjkN9YjOWMCW1veSaiKYUxr1SaVGN6D8bsYtVz94rH8MgMnXHNMOQ3twr-mW9qa-5kmlnf94Q0d0eQvaqgapjM Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:39:10.464085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8404651e9fb4443a9cdebb3f79a4e6a8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8404651e9fb4443a9cdebb3f79a4e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 8404651e9fb4443a9cdebb3f79a4e6a8 Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-74888258 Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 9528a9a3306d49b0978d77d1ce1ca900 Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-74888258-project Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 could not be found. Jul 07 15:39:10.465585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '73c2472d-0015-49d1-ab4c-7eb597cbaa69'} Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 could not be found. Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:39:10.466369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 could not be found. Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 could not be found. Jul 07 15:39:10.467874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:10.469356 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] Returning 404 to user: Instance 73c2472d-0015-49d1-ab4c-7eb597cbaa69 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:39:10.469356 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d0fcabcd-95f5-4814-ace4-f9f2e3dd3b22 tempest-ServerRescueNegativeTestJSON-74888258 tempest-ServerRescueNegativeTestJSON-74888258-project] 10.222.0.25 "GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69" status: 404 len: 111 microversion: 2.1 time: 0.029118 Jul 07 15:39:10.469356 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 383/767] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:10 2022] GET /compute/v2.1/servers/73c2472d-0015-49d1-ab4c-7eb597cbaa69 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:39:10.512580 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:10.513346 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:10.515862 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:10.521690 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:10.522209 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:10.523280 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:10.524109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:10.667886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:10.676335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:10.677974 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:10.679315 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7351ff1c-da61-493f-8cd1-d882030d02f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1743 microversion: 2.20 time: 0.170789 Jul 07 15:39:10.680263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 385/768] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:10 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:11.698404 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:11.699464 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:11.707495 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:11.709011 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:11.709800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:11.710281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:11.891296 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:11.903622 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:11.905556 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:11.906962 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e96fa823-63cf-4860-9329-9db297a58a15 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.212763 Jul 07 15:39:11.907806 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 384/769] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:11 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:12.782201 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-35b3a924-52f1-4102-a579-bc74f11476a7 req-caf7dc5a-a07f-4401-be96-b7f30b0dc58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cfd6f9-be72-41c0-8887-1425b3f5565c", "name": "network-vif-plugged", "status": "completed", "tag": "cd19f05f-6752-480d-a56b-5d74f03e8e3a"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:12.797425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-35b3a924-52f1-4102-a579-bc74f11476a7 req-caf7dc5a-a07f-4401-be96-b7f30b0dc58e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:12.798270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-35b3a924-52f1-4102-a579-bc74f11476a7 req-caf7dc5a-a07f-4401-be96-b7f30b0dc58e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:12.812119 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-35b3a924-52f1-4102-a579-bc74f11476a7 req-caf7dc5a-a07f-4401-be96-b7f30b0dc58e service nova] Creating event network-vif-plugged:cd19f05f-6752-480d-a56b-5d74f03e8e3a for instance d8cfd6f9-be72-41c0-8887-1425b3f5565c on hv-cinder-84130 Jul 07 15:39:12.819863 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-35b3a924-52f1-4102-a579-bc74f11476a7 req-caf7dc5a-a07f-4401-be96-b7f30b0dc58e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127867 Jul 07 15:39:12.821640 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 386/770] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:12.931060 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:12.932811 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:12.942042 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:12.942945 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:12.946862 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:12.947641 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:13.074413 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7b47d478-4298-44fe-98e8-bf04c41b6989 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:13.075229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7b47d478-4298-44fe-98e8-bf04c41b6989 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:13.096227 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7b47d478-4298-44fe-98e8-bf04c41b6989 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:13.104829 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7b47d478-4298-44fe-98e8-bf04c41b6989 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:13.110674 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7b47d478-4298-44fe-98e8-bf04c41b6989 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:13.111455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7b47d478-4298-44fe-98e8-bf04c41b6989 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:13.146392 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-7b47d478-4298-44fe-98e8-bf04c41b6989 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lazy-loading 'flavor' on Instance uuid 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:39:13.228695 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:13.240405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:13.242432 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:13.243706 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-08a2f941-e46e-43ea-b4f3-242eb366c89b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.318033 Jul 07 15:39:13.247942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 385/771] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:12 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:13.454103 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7b47d478-4298-44fe-98e8-bf04c41b6989 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "POST /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8/action" status: 202 len: 0 microversion: 2.1 time: 0.384286 Jul 07 15:39:13.455375 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 387/772] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:39:13 2022] POST /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 15:39:13.464257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-46df79c5-349c-4ed3-8c1f-406970458f47 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:13.468488 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-46df79c5-349c-4ed3-8c1f-406970458f47 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:13.484139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46df79c5-349c-4ed3-8c1f-406970458f47 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:13.484869 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46df79c5-349c-4ed3-8c1f-406970458f47 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:13.486280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46df79c5-349c-4ed3-8c1f-406970458f47 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:13.486725 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46df79c5-349c-4ed3-8c1f-406970458f47 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:13.694739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-46df79c5-349c-4ed3-8c1f-406970458f47 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:13.705188 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-46df79c5-349c-4ed3-8c1f-406970458f47 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.244931 Jul 07 15:39:13.709205 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 386/773] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:13 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:14.262953 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:14.263676 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:14.271472 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:14.272258 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:14.273254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:14.273772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:14.537111 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:14.545383 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:14.546905 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:14.549780 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7a5b49f1-3607-4fcd-8e04-5638cfcd71cb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.291215 Jul 07 15:39:14.552099 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 388/774] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:14 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:14.725657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-03e5270f-1358-453d-8305-96db74a458e2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:14.726223 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-03e5270f-1358-453d-8305-96db74a458e2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:14.736644 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-03e5270f-1358-453d-8305-96db74a458e2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:14.737939 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-03e5270f-1358-453d-8305-96db74a458e2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:14.738947 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-03e5270f-1358-453d-8305-96db74a458e2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:14.739448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-03e5270f-1358-453d-8305-96db74a458e2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:14.911969 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-03e5270f-1358-453d-8305-96db74a458e2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:14.921907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-03e5270f-1358-453d-8305-96db74a458e2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.200206 Jul 07 15:39:14.922528 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 387/775] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:14 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:15.569259 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:15.570087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:15.577114 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:15.577874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:15.578893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:15.579553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:15.859054 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:15.859054 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:15.860091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:15.860091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-01fa7e7f-68b7-4b83-8032-f6e33baa2bf1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.172862 Jul 07 15:39:15.860091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 389/776] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:15 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:15.943913 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3b2286e8-2692-493c-bd2d-219c65523307 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:15.944534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3b2286e8-2692-493c-bd2d-219c65523307 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:15.951302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3b2286e8-2692-493c-bd2d-219c65523307 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:15.951805 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3b2286e8-2692-493c-bd2d-219c65523307 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:15.952517 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3b2286e8-2692-493c-bd2d-219c65523307 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:15.952994 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3b2286e8-2692-493c-bd2d-219c65523307 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:16.113040 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3b2286e8-2692-493c-bd2d-219c65523307 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:16.123750 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3b2286e8-2692-493c-bd2d-219c65523307 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.184165 Jul 07 15:39:16.124331 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 388/777] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:15 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:16.874142 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:16.874749 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:16.882253 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:16.883304 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:16.884560 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:16.885155 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:16.911150 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:16.954948 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7c14cc6d-4159-4d29-a570-e84038bc4b2c tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Action: 'create', calling method: .version_select at 0x7f5249700af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1670611490", "metadata": {"Type": "work"}}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7c14cc6d-4159-4d29-a570-e84038bc4b2c tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Request method failure captured: Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 122 Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv4kFeNwqbUD1VqvaJbV4z_3YWgoP8KwGVYHzzKh9Mdbzwx5MMtYe05YrgmRkwn7lgLimqKRjo7CCvkOxWxF97st2GiyCzMXI6wsLEpDFBXZt6oBJJcmcdeNBfekUcL5BWefo97bVMWTp4N_IsIQ1tc2PCJjmDsVgWEZGc17WZSd2z4 Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:39:16.978773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faef7e30953a41508d6f854702d13b0d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 23a33ea5c6014c7eaa9f766553245d50 Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1670611490", "metadata": {"Type": "work"}}} Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: Jul 07 15:39:16.980288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1670611490', 'metadata': {'Type': 'work'}}}} Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise error Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi '#$%' Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:39:16.981322 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 15:39:16.983270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 15:39:16.984822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 15:39:16.984822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.984822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7c14cc6d-4159-4d29-a570-e84038bc4b2c tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:39:16.984822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7c14cc6d-4159-4d29-a570-e84038bc4b2c tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.179854 Jul 07 15:39:16.984822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 390/778] 10.222.0.25 () {60 vars in 1155 bytes} [Thu Jul 7 15:39:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 15:39:16.991342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-86ab66f3-6b36-4da3-a3cc-717db31fbdb7 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Action: 'create', calling method: .version_select at 0x7f52495a65e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-94856420", "metadata": {"Type": "work"}}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-86ab66f3-6b36-4da3-a3cc-717db31fbdb7 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Request method failure captured: Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 118 Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv4kFeNwqbUD1VqvaJbV4z_3YWgoP8KwGVYHzzKh9Mdbzwx5MMtYe05YrgmRkwn7lgLimqKRjo7CCvkOxWxF97st2GiyCzMXI6wsLEpDFBXZt6oBJJcmcdeNBfekUcL5BWefo97bVMWTp4N_IsIQ1tc2PCJjmDsVgWEZGc17WZSd2z4 Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:39:16.994349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faef7e30953a41508d6f854702d13b0d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 23a33ea5c6014c7eaa9f766553245d50 Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-94856420", "metadata": {"Type": "work"}}} Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: Jul 07 15:39:16.995977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-94856420', 'metadata': {'Type': 'work'}}}} Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise error Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi '0' Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:39:16.996919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 15:39:16.998393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 15:39:17.003379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 15:39:17.003379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.003379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-86ab66f3-6b36-4da3-a3cc-717db31fbdb7 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:39:17.003379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-86ab66f3-6b36-4da3-a3cc-717db31fbdb7 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008174 Jul 07 15:39:17.003379 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 391/779] 10.222.0.25 () {60 vars in 1155 bytes} [Thu Jul 7 15:39:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 15:39:17.009580 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b3c80e6f-7b8f-4f07-8556-049f4f6e75df tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Action: 'create', calling method: .version_select at 0x7f524966b700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1414958052", "metadata": {"Type": "work"}}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b3c80e6f-7b8f-4f07-8556-049f4f6e75df tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Request method failure captured: Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 119 Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv4kFeNwqbUD1VqvaJbV4z_3YWgoP8KwGVYHzzKh9Mdbzwx5MMtYe05YrgmRkwn7lgLimqKRjo7CCvkOxWxF97st2GiyCzMXI6wsLEpDFBXZt6oBJJcmcdeNBfekUcL5BWefo97bVMWTp4N_IsIQ1tc2PCJjmDsVgWEZGc17WZSd2z4 Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:39:17.012146 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faef7e30953a41508d6f854702d13b0d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 23a33ea5c6014c7eaa9f766553245d50 Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1414958052", "metadata": {"Type": "work"}}} Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: Jul 07 15:39:17.013728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1414958052', 'metadata': {'Type': 'work'}}}} Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise error Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi '' Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:39:17.015460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 15:39:17.017044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 15:39:17.018943 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 15:39:17.018943 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.019514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b3c80e6f-7b8f-4f07-8556-049f4f6e75df tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:39:17.020397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b3c80e6f-7b8f-4f07-8556-049f4f6e75df tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014849 Jul 07 15:39:17.021384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 392/780] 10.222.0.25 () {60 vars in 1155 bytes} [Thu Jul 7 15:39:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 15:39:17.030286 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ae2fe421-89bd-415a-b3f6-0dd312363225 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Calling method '.version_select at 0x7f52495d80d0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:17.071435 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-ae2fe421-89bd-415a-b3f6-0dd312363225 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] HTTP exception thrown: Volume tempest-invalid-978878300 could not be found. Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ae2fe421-89bd-415a-b3f6-0dd312363225 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Request method failure captured: Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-978878300 HTTP/1.1 Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv4kFeNwqbUD1VqvaJbV4z_3YWgoP8KwGVYHzzKh9Mdbzwx5MMtYe05YrgmRkwn7lgLimqKRjo7CCvkOxWxF97st2GiyCzMXI6wsLEpDFBXZt6oBJJcmcdeNBfekUcL5BWefo97bVMWTp4N_IsIQ1tc2PCJjmDsVgWEZGc17WZSd2z4 Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:39:17.073985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faef7e30953a41508d6f854702d13b0d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 23a33ea5c6014c7eaa9f766553245d50 Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Volume tempest-invalid-978878300 could not be found. Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'tempest-invalid-978878300'} Jul 07 15:39:17.075279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-978878300 could not be found. (HTTP 404) (Request-ID: req-6e36ef10-f16b-4688-b23b-ffbb2801e3a6) Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.076297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 15:39:17.077968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-978878300 could not be found. Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:39:17.079240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-978878300 could not be found. Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-978878300 could not be found. Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ae2fe421-89bd-415a-b3f6-0dd312363225 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Returning 404 to user: Volume tempest-invalid-978878300 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ae2fe421-89bd-415a-b3f6-0dd312363225 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-978878300" status: 404 len: 98 microversion: 2.1 time: 0.049190 Jul 07 15:39:17.081185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 393/781] 10.222.0.25 () {58 vars in 1214 bytes} [Thu Jul 7 15:39:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-978878300 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 07 15:39:17.089324 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:17.094260 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-75554088-f894-4362-a328-efefd488ae5a tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010905 Jul 07 15:39:17.095619 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 394/782] 10.222.0.25 () {58 vars in 1139 bytes} [Thu Jul 7 15:39:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 07 15:39:17.106655 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:17.108533 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:17.110171 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c7e6f49e-22c2-417e-b2cf-0eb6d05242f6 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008357 Jul 07 15:39:17.110452 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-76c45d90-3145-4f93-b812-c5088d22c26d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.240650 Jul 07 15:39:17.110938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 395/783] 10.222.0.25 () {58 vars in 1136 bytes} [Thu Jul 7 15:39:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 07 15:39:17.111437 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 389/784] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:16 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:17.122578 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e5cbabd9-6f61-4fb5-87a9-c6e6ad8457a5 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Calling method '.version_select at 0x7f5249801f70>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:17.141907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d6ba0671-9c05-4dd0-b064-f49e922faa85 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:17.142651 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d6ba0671-9c05-4dd0-b064-f49e922faa85 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:17.153703 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d6ba0671-9c05-4dd0-b064-f49e922faa85 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:17.154143 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d6ba0671-9c05-4dd0-b064-f49e922faa85 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:17.154918 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d6ba0671-9c05-4dd0-b064-f49e922faa85 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:17.155351 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d6ba0671-9c05-4dd0-b064-f49e922faa85 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:17.163084 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-e5cbabd9-6f61-4fb5-87a9-c6e6ad8457a5 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] HTTP exception thrown: Volume d9751818-a3e5-49de-8d1a-9749545c4b86 could not be found. Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e5cbabd9-6f61-4fb5-87a9-c6e6ad8457a5 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Request method failure captured: Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: DELETE /compute/v2.1/os-volumes/d9751818-a3e5-49de-8d1a-9749545c4b86 HTTP/1.1 Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv4kFeNwqbUD1VqvaJbV4z_3YWgoP8KwGVYHzzKh9Mdbzwx5MMtYe05YrgmRkwn7lgLimqKRjo7CCvkOxWxF97st2GiyCzMXI6wsLEpDFBXZt6oBJJcmcdeNBfekUcL5BWefo97bVMWTp4N_IsIQ1tc2PCJjmDsVgWEZGc17WZSd2z4 Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:39:17.165244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faef7e30953a41508d6f854702d13b0d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 23a33ea5c6014c7eaa9f766553245d50 Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Volume d9751818-a3e5-49de-8d1a-9749545c4b86 could not be found. Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'd9751818-a3e5-49de-8d1a-9749545c4b86'} Jul 07 15:39:17.166667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9751818-a3e5-49de-8d1a-9749545c4b86 could not be found. (HTTP 404) (Request-ID: req-24eac6b4-513d-4ea3-bcd8-2f840944990e) Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.167621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 15:39:17.179141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9751818-a3e5-49de-8d1a-9749545c4b86 could not be found. Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 15:39:17.180664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9751818-a3e5-49de-8d1a-9749545c4b86 could not be found. Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9751818-a3e5-49de-8d1a-9749545c4b86 could not be found. Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e5cbabd9-6f61-4fb5-87a9-c6e6ad8457a5 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Returning 404 to user: Volume d9751818-a3e5-49de-8d1a-9749545c4b86 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e5cbabd9-6f61-4fb5-87a9-c6e6ad8457a5 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/d9751818-a3e5-49de-8d1a-9749545c4b86" status: 404 len: 109 microversion: 2.1 time: 0.051276 Jul 07 15:39:17.181986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 396/785] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:39:17 2022] DELETE /compute/v2.1/os-volumes/d9751818-a3e5-49de-8d1a-9749545c4b86 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:39:17.185130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a590d1f8-f3ed-498a-8e40-f449fbbae239 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Calling method '.version_select at 0x7f524971ea60>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:17.221777 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-a590d1f8-f3ed-498a-8e40-f449fbbae239 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] HTTP exception thrown: Volume 92d3f674-3268-4052-bcf8-619504527595 could not be found. Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a590d1f8-f3ed-498a-8e40-f449fbbae239 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Request method failure captured: Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/os-volumes/92d3f674-3268-4052-bcf8-619504527595 HTTP/1.1 Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv4kFeNwqbUD1VqvaJbV4z_3YWgoP8KwGVYHzzKh9Mdbzwx5MMtYe05YrgmRkwn7lgLimqKRjo7CCvkOxWxF97st2GiyCzMXI6wsLEpDFBXZt6oBJJcmcdeNBfekUcL5BWefo97bVMWTp4N_IsIQ1tc2PCJjmDsVgWEZGc17WZSd2z4 Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:39:17.223937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_faef7e30953a41508d6f854702d13b0d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/faef7e30953a41508d6f854702d13b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: faef7e30953a41508d6f854702d13b0d Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesNegativeTest-861356269 Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 23a33ea5c6014c7eaa9f766553245d50 Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesNegativeTest-861356269-project Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Volume 92d3f674-3268-4052-bcf8-619504527595 could not be found. Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '92d3f674-3268-4052-bcf8-619504527595'} Jul 07 15:39:17.225261 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92d3f674-3268-4052-bcf8-619504527595 could not be found. (HTTP 404) (Request-ID: req-31a0b9d5-ce88-48a9-a2f2-aae9baeafab1) Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.226042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:39:17.227221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92d3f674-3268-4052-bcf8-619504527595 could not be found. Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 15:39:17.228370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92d3f674-3268-4052-bcf8-619504527595 could not be found. Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92d3f674-3268-4052-bcf8-619504527595 could not be found. Jul 07 15:39:17.229491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:39:17.231326 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a590d1f8-f3ed-498a-8e40-f449fbbae239 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] Returning 404 to user: Volume 92d3f674-3268-4052-bcf8-619504527595 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:39:17.232222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a590d1f8-f3ed-498a-8e40-f449fbbae239 tempest-VolumesNegativeTest-861356269 tempest-VolumesNegativeTest-861356269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/92d3f674-3268-4052-bcf8-619504527595" status: 404 len: 109 microversion: 2.1 time: 0.058665 Jul 07 15:39:17.239467 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 397/786] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:39:17 2022] GET /compute/v2.1/os-volumes/92d3f674-3268-4052-bcf8-619504527595 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 15:39:17.329739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d6ba0671-9c05-4dd0-b064-f49e922faa85 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:17.338790 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d6ba0671-9c05-4dd0-b064-f49e922faa85 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.200886 Jul 07 15:39:17.340509 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 390/787] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:17 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:18.135079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:18.136968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:18.145390 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:18.146335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:18.147497 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:18.148230 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:18.305061 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:18.320395 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:18.323604 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:18.325028 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bfe683e5-f645-4509-a593-b01da7b81cb5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.194987 Jul 07 15:39:18.326225 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 398/788] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:18 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:18.357327 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-65ce03be-f11a-4ba2-b802-c380e135f742 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:18.363205 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-65ce03be-f11a-4ba2-b802-c380e135f742 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:18.365403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-65ce03be-f11a-4ba2-b802-c380e135f742 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:18.365958 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-65ce03be-f11a-4ba2-b802-c380e135f742 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:18.369371 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-65ce03be-f11a-4ba2-b802-c380e135f742 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:18.370824 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-65ce03be-f11a-4ba2-b802-c380e135f742 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:18.534640 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-65ce03be-f11a-4ba2-b802-c380e135f742 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:18.543012 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-65ce03be-f11a-4ba2-b802-c380e135f742 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.189659 Jul 07 15:39:18.543610 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 391/789] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:18 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:19.344054 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:19.344699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:19.352114 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:19.352591 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:19.353363 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:19.353795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:19.497426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:19.499794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:19.506168 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:19.507709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:19.508867 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7d04f2a2-5d60-4d5d-819c-d0543bb65792 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.168901 Jul 07 15:39:19.509424 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 399/790] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:19 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:19.560345 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f227c4fb-4873-49a4-9b4b-65d5d1a2aff7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:19.560977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f227c4fb-4873-49a4-9b4b-65d5d1a2aff7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:19.567323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f227c4fb-4873-49a4-9b4b-65d5d1a2aff7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:19.567809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f227c4fb-4873-49a4-9b4b-65d5d1a2aff7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:19.568564 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f227c4fb-4873-49a4-9b4b-65d5d1a2aff7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:19.568991 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f227c4fb-4873-49a4-9b4b-65d5d1a2aff7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:19.727690 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f227c4fb-4873-49a4-9b4b-65d5d1a2aff7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:19.737937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f227c4fb-4873-49a4-9b4b-65d5d1a2aff7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.181298 Jul 07 15:39:19.738600 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 392/791] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:19 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:39:20.527717 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:20.528469 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:20.535452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:20.537121 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:20.542605 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:20.544192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:20.740416 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:20.750667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:20.752726 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:20.754148 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-dc650d05-0cb3-4cf7-ada0-51068cea9329 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.231694 Jul 07 15:39:20.754701 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 400/792] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:20 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:20.756134 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f948757a-9f33-4735-8ada-7812d2a17dc9 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:20.756744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f948757a-9f33-4735-8ada-7812d2a17dc9 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:20.770466 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f948757a-9f33-4735-8ada-7812d2a17dc9 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:20.770909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f948757a-9f33-4735-8ada-7812d2a17dc9 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:20.771708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f948757a-9f33-4735-8ada-7812d2a17dc9 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:20.772326 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f948757a-9f33-4735-8ada-7812d2a17dc9 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:20.933108 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f948757a-9f33-4735-8ada-7812d2a17dc9 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:20.940938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f948757a-9f33-4735-8ada-7812d2a17dc9 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.188480 Jul 07 15:39:20.944206 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 393/793] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:20 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:21.773106 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:21.773700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:21.785912 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:21.786371 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:21.787154 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:21.787845 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:21.946987 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:21.955397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:21.957258 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:21.958624 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8e413c84-9d53-4f7b-b727-b851b476f9fc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.189520 Jul 07 15:39:21.969780 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 401/794] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:21 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:21.975965 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-bf28edce-c1a9-45dd-ac5c-f83be6f1a563 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:21.979522 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-bf28edce-c1a9-45dd-ac5c-f83be6f1a563 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:21.987919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf28edce-c1a9-45dd-ac5c-f83be6f1a563 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:21.989240 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf28edce-c1a9-45dd-ac5c-f83be6f1a563 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:21.990020 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf28edce-c1a9-45dd-ac5c-f83be6f1a563 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:21.990457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf28edce-c1a9-45dd-ac5c-f83be6f1a563 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:22.137152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-bf28edce-c1a9-45dd-ac5c-f83be6f1a563 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:22.146791 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-bf28edce-c1a9-45dd-ac5c-f83be6f1a563 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.192101 Jul 07 15:39:22.147702 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 394/795] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:21 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:22.977436 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:22.978047 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:22.985691 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:22.986166 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:22.986899 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:22.987333 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:23.138757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:23.147387 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:23.149231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:23.150428 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-989ac817-3008-4612-8258-c2c64d35984a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.176878 Jul 07 15:39:23.150985 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 402/796] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:22 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:23.165002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-52f7c62d-68d3-4e64-b7d7-37d3483a024b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:23.169012 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-52f7c62d-68d3-4e64-b7d7-37d3483a024b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:23.176823 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52f7c62d-68d3-4e64-b7d7-37d3483a024b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:23.177293 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52f7c62d-68d3-4e64-b7d7-37d3483a024b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:23.178064 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52f7c62d-68d3-4e64-b7d7-37d3483a024b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:23.178504 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-52f7c62d-68d3-4e64-b7d7-37d3483a024b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:23.333289 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-52f7c62d-68d3-4e64-b7d7-37d3483a024b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:23.341153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-52f7c62d-68d3-4e64-b7d7-37d3483a024b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.180926 Jul 07 15:39:23.351224 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 395/797] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:23 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:24.171800 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:24.172334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:24.179679 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:24.180128 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:24.180896 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:24.181330 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:24.318232 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:24.327179 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:24.328701 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:24.329852 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-efacdff0-77a3-436b-91e9-8f6b5bf3a939 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1738 microversion: 2.20 time: 0.162052 Jul 07 15:39:24.330601 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 403/798] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:24 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:24.358276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cd96734a-988a-4fa9-be50-1e3d31624697 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:24.359815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cd96734a-988a-4fa9-be50-1e3d31624697 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:24.366911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd96734a-988a-4fa9-be50-1e3d31624697 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:24.367577 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd96734a-988a-4fa9-be50-1e3d31624697 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:24.368391 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd96734a-988a-4fa9-be50-1e3d31624697 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:24.368975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cd96734a-988a-4fa9-be50-1e3d31624697 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:24.526468 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cd96734a-988a-4fa9-be50-1e3d31624697 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:24.535709 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cd96734a-988a-4fa9-be50-1e3d31624697 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.180865 Jul 07 15:39:24.536825 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 396/799] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:24 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:25.348724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:25.349514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:25.355922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:25.356372 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:25.357127 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:25.357554 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:25.493034 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:25.500935 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:25.502432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:25.503586 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a490c4c8-a09b-46cc-939e-bee86c95ee47 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1720 microversion: 2.20 time: 0.158760 Jul 07 15:39:25.504153 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 404/800] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:25 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:25.553503 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3164742f-1cbe-4717-b463-bc9baf6bf478 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:25.554188 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3164742f-1cbe-4717-b463-bc9baf6bf478 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:25.560504 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3164742f-1cbe-4717-b463-bc9baf6bf478 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:25.560943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3164742f-1cbe-4717-b463-bc9baf6bf478 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:25.561745 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3164742f-1cbe-4717-b463-bc9baf6bf478 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:25.562381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3164742f-1cbe-4717-b463-bc9baf6bf478 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:25.692700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3164742f-1cbe-4717-b463-bc9baf6bf478 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:25.700500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3164742f-1cbe-4717-b463-bc9baf6bf478 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.151380 Jul 07 15:39:25.705453 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 397/801] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:25 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:26.522812 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:26.523967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:26.534301 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:26.534748 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:26.535540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:26.536004 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:26.669342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:26.677897 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:26.679399 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:26.680580 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9a4a3ad2-871e-4a0f-8f42-a34d813f3835 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1720 microversion: 2.20 time: 0.162445 Jul 07 15:39:26.681138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 405/802] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:26 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:26.717384 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8f77e1c4-9f06-4f2c-8473-22dfd7e471b6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:26.718012 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8f77e1c4-9f06-4f2c-8473-22dfd7e471b6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:26.724460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f77e1c4-9f06-4f2c-8473-22dfd7e471b6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:26.724900 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f77e1c4-9f06-4f2c-8473-22dfd7e471b6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:26.725646 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f77e1c4-9f06-4f2c-8473-22dfd7e471b6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:26.726071 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f77e1c4-9f06-4f2c-8473-22dfd7e471b6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:26.860667 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8f77e1c4-9f06-4f2c-8473-22dfd7e471b6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:26.868655 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8f77e1c4-9f06-4f2c-8473-22dfd7e471b6 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.155061 Jul 07 15:39:26.869217 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 398/803] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:26 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:27.271646 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-29a6c991-c6a4-419b-90b2-ce63c00463b4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:27.272310 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-29a6c991-c6a4-419b-90b2-ce63c00463b4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:27.278265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-29a6c991-c6a4-419b-90b2-ce63c00463b4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:27.278708 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-29a6c991-c6a4-419b-90b2-ce63c00463b4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:27.279500 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-29a6c991-c6a4-419b-90b2-ce63c00463b4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:27.279959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-29a6c991-c6a4-419b-90b2-ce63c00463b4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:27.303297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-29a6c991-c6a4-419b-90b2-ce63c00463b4 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/ips" status: 200 len: 144 microversion: 2.1 time: 0.035520 Jul 07 15:39:27.303894 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 406/804] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:39:27 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:27.698296 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:27.698974 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:27.705076 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:27.705521 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:27.706385 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:27.706818 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:27.851515 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:27.860232 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:27.861726 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:27.862904 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2101fb07-1451-4882-8ecb-6e7a32efebbf tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1720 microversion: 2.20 time: 0.168472 Jul 07 15:39:27.863815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 399/805] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:27 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:27.886865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1d037767-ac3e-40b8-ab52-03a16d3c6536 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:27.888363 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1d037767-ac3e-40b8-ab52-03a16d3c6536 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:27.895635 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1d037767-ac3e-40b8-ab52-03a16d3c6536 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:27.896587 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1d037767-ac3e-40b8-ab52-03a16d3c6536 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:27.897771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1d037767-ac3e-40b8-ab52-03a16d3c6536 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:27.898230 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1d037767-ac3e-40b8-ab52-03a16d3c6536 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:28.040936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1d037767-ac3e-40b8-ab52-03a16d3c6536 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:28.048954 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1d037767-ac3e-40b8-ab52-03a16d3c6536 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.166875 Jul 07 15:39:28.049521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 407/806] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:27 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:28.515921 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3e4d388e-4d13-41e6-8c3e-be5f7717dc58 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:28.516685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3e4d388e-4d13-41e6-8c3e-be5f7717dc58 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:28.523736 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3e4d388e-4d13-41e6-8c3e-be5f7717dc58 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:28.524284 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3e4d388e-4d13-41e6-8c3e-be5f7717dc58 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:28.525133 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3e4d388e-4d13-41e6-8c3e-be5f7717dc58 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:28.525681 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3e4d388e-4d13-41e6-8c3e-be5f7717dc58 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:28.549254 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3e4d388e-4d13-41e6-8c3e-be5f7717dc58 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/ips" status: 200 len: 149 microversion: 2.1 time: 0.037100 Jul 07 15:39:28.549849 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 400/807] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:39:28 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:28.702652 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-8249d900-1847-4475-b60f-a1f9524bf6c3 req-739de46a-3ef3-4c74-aa64-5708db7ce611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cfd6f9-be72-41c0-8887-1425b3f5565c", "name": "network-vif-unplugged", "status": "completed", "tag": "cd19f05f-6752-480d-a56b-5d74f03e8e3a"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:28.711515 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-8249d900-1847-4475-b60f-a1f9524bf6c3 req-739de46a-3ef3-4c74-aa64-5708db7ce611 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:28.711980 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-8249d900-1847-4475-b60f-a1f9524bf6c3 req-739de46a-3ef3-4c74-aa64-5708db7ce611 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:28.723191 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-8249d900-1847-4475-b60f-a1f9524bf6c3 req-739de46a-3ef3-4c74-aa64-5708db7ce611 service nova] Creating event network-vif-unplugged:cd19f05f-6752-480d-a56b-5d74f03e8e3a for instance d8cfd6f9-be72-41c0-8887-1425b3f5565c on hv-cinder-84130 Jul 07 15:39:28.728317 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-8249d900-1847-4475-b60f-a1f9524bf6c3 req-739de46a-3ef3-4c74-aa64-5708db7ce611 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029294 Jul 07 15:39:28.728928 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 408/808] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:28.881473 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:28.885478 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:28.893533 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:28.893979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:28.895262 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:28.896865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:29.039933 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3f2f2a48-befe-4a1f-8f71-1a799f2ba606 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59390504-35ba-4d92-b305-24fc821caf36"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:29.041967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3f2f2a48-befe-4a1f-8f71-1a799f2ba606 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:29.050987 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:29.063898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:29.065551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:29.066755 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c656165f-aab0-4046-ba13-781151275e74 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1723 microversion: 2.20 time: 0.189166 Jul 07 15:39:29.066903 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f2f2a48-befe-4a1f-8f71-1a799f2ba606 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:29.067989 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 401/809] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:28 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:29.072625 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-73f6d70e-4f38-4a72-8d69-bfcd23e77ea0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:29.073226 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-73f6d70e-4f38-4a72-8d69-bfcd23e77ea0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:29.076082 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f2f2a48-befe-4a1f-8f71-1a799f2ba606 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:29.076941 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f2f2a48-befe-4a1f-8f71-1a799f2ba606 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:29.077386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3f2f2a48-befe-4a1f-8f71-1a799f2ba606 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:29.081375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-73f6d70e-4f38-4a72-8d69-bfcd23e77ea0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:29.089160 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-73f6d70e-4f38-4a72-8d69-bfcd23e77ea0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:29.089160 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-73f6d70e-4f38-4a72-8d69-bfcd23e77ea0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:29.089160 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-73f6d70e-4f38-4a72-8d69-bfcd23e77ea0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:29.254788 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-73f6d70e-4f38-4a72-8d69-bfcd23e77ea0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:29.262355 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-73f6d70e-4f38-4a72-8d69-bfcd23e77ea0 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1569 microversion: 2.1 time: 0.193275 Jul 07 15:39:29.262910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 402/810] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:29 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:29.267559 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1ed6f319-1a29-4b8c-8ebc-0948107b46d9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46ccc060-a070-4253-892f-ac7f09e0078a"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:29.268667 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1ed6f319-1a29-4b8c-8ebc-0948107b46d9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:29.275041 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ed6f319-1a29-4b8c-8ebc-0948107b46d9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:29.275488 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ed6f319-1a29-4b8c-8ebc-0948107b46d9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:29.276330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ed6f319-1a29-4b8c-8ebc-0948107b46d9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:29.276760 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ed6f319-1a29-4b8c-8ebc-0948107b46d9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:30.133288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3f2f2a48-befe-4a1f-8f71-1a799f2ba606 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.096049 Jul 07 15:39:30.133288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 409/811] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:39:29 2022] POST /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments => generated 194 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:39:30.135355 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3709d929-048f-47a2-b84b-bae4cb079b45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:30.136036 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3709d929-048f-47a2-b84b-bae4cb079b45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:30.142191 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3709d929-048f-47a2-b84b-bae4cb079b45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:30.142637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3709d929-048f-47a2-b84b-bae4cb079b45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:30.143400 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3709d929-048f-47a2-b84b-bae4cb079b45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:30.144020 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3709d929-048f-47a2-b84b-bae4cb079b45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:30.268940 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:30.342219 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1ed6f319-1a29-4b8c-8ebc-0948107b46d9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.078117 Jul 07 15:39:30.343323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 403/812] 10.222.0.25 () {62 vars in 1363 bytes} [Thu Jul 7 15:39:29 2022] POST /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/os-volume_attachments => generated 188 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 15:39:30.351533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3709d929-048f-47a2-b84b-bae4cb079b45 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "POST /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8/action" status: 202 len: 0 microversion: 2.1 time: 0.220191 Jul 07 15:39:30.352318 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 410/813] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:39:30 2022] POST /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:39:30.356971 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9bcd3a9b-22c8-40a1-a80d-be37f01d518b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e08231f-6327-4ff3-ace7-d717461c5783"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:30.356971 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9bcd3a9b-22c8-40a1-a80d-be37f01d518b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:30.366479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-81adeaf3-52a1-4739-8dfa-ea45572ad0c2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:30.367480 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-81adeaf3-52a1-4739-8dfa-ea45572ad0c2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:30.368572 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9bcd3a9b-22c8-40a1-a80d-be37f01d518b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:30.369020 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9bcd3a9b-22c8-40a1-a80d-be37f01d518b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:30.369779 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9bcd3a9b-22c8-40a1-a80d-be37f01d518b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:30.370385 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9bcd3a9b-22c8-40a1-a80d-be37f01d518b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:30.375354 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-81adeaf3-52a1-4739-8dfa-ea45572ad0c2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:30.375960 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-81adeaf3-52a1-4739-8dfa-ea45572ad0c2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:30.377088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-81adeaf3-52a1-4739-8dfa-ea45572ad0c2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:30.377678 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-81adeaf3-52a1-4739-8dfa-ea45572ad0c2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:30.544961 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-81adeaf3-52a1-4739-8dfa-ea45572ad0c2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:30.552796 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-81adeaf3-52a1-4739-8dfa-ea45572ad0c2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1517 microversion: 2.1 time: 0.192393 Jul 07 15:39:30.553363 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 411/814] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:30 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:39:30.748368 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-f1ca9c0a-df9e-4b40-995e-42d70216f3cb req-70dc4148-bdf6-4654-9d7e-3037a858e0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8af2eb-fd79-4b8d-a9ef-648a1959ded8", "name": "network-vif-unplugged", "status": "completed", "tag": "bcf3a191-4ef0-4048-9b74-408448e7ee6d"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:30.760404 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-f1ca9c0a-df9e-4b40-995e-42d70216f3cb req-70dc4148-bdf6-4654-9d7e-3037a858e0a4 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:30.761106 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-f1ca9c0a-df9e-4b40-995e-42d70216f3cb req-70dc4148-bdf6-4654-9d7e-3037a858e0a4 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:30.787783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.compute.server_external_events [req-f1ca9c0a-df9e-4b40-995e-42d70216f3cb req-70dc4148-bdf6-4654-9d7e-3037a858e0a4 service nova] Unable to find a host for instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8. Dropping event network-vif-unplugged {{(pid=124719) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 07 15:39:30.788692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-f1ca9c0a-df9e-4b40-995e-42d70216f3cb req-70dc4148-bdf6-4654-9d7e-3037a858e0a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048255 Jul 07 15:39:30.789463 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 412/815] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 07 15:39:30.794946 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-57c40401-3c79-421c-8dcc-5ed56ffd9135 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:30.795832 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-57c40401-3c79-421c-8dcc-5ed56ffd9135 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:30.803919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57c40401-3c79-421c-8dcc-5ed56ffd9135 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:30.804373 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57c40401-3c79-421c-8dcc-5ed56ffd9135 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:30.805229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57c40401-3c79-421c-8dcc-5ed56ffd9135 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:30.805716 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57c40401-3c79-421c-8dcc-5ed56ffd9135 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:31.413072 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:31.443733 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9bcd3a9b-22c8-40a1-a80d-be37f01d518b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "POST /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.098939 Jul 07 15:39:31.447356 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 404/816] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:39:30 2022] POST /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 194 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:31.534361 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-57c40401-3c79-421c-8dcc-5ed56ffd9135 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/os-volume_attachments/46ccc060-a070-4253-892f-ac7f09e0078a" status: 202 len: 0 microversion: 2.20 time: 0.743567 Jul 07 15:39:31.535382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 413/817] 10.222.0.25 () {60 vars in 1456 bytes} [Thu Jul 7 15:39:30 2022] DELETE /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/os-volume_attachments/46ccc060-a070-4253-892f-ac7f09e0078a => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 07 15:39:31.570005 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-299dd602-4f7a-42fc-9851-ad7ee28ce8b1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:31.570687 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-299dd602-4f7a-42fc-9851-ad7ee28ce8b1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:31.577493 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-299dd602-4f7a-42fc-9851-ad7ee28ce8b1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:31.577942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-299dd602-4f7a-42fc-9851-ad7ee28ce8b1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:31.578889 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-299dd602-4f7a-42fc-9851-ad7ee28ce8b1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:31.579339 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-299dd602-4f7a-42fc-9851-ad7ee28ce8b1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:31.596752 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2e0a2d75-aa64-4bc2-bace-dd040e79cf95 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:31.597384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2e0a2d75-aa64-4bc2-bace-dd040e79cf95 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:31.604634 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e0a2d75-aa64-4bc2-bace-dd040e79cf95 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:31.605086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e0a2d75-aa64-4bc2-bace-dd040e79cf95 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:31.605862 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e0a2d75-aa64-4bc2-bace-dd040e79cf95 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:31.606295 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e0a2d75-aa64-4bc2-bace-dd040e79cf95 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:31.714556 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-299dd602-4f7a-42fc-9851-ad7ee28ce8b1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:31.722089 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-299dd602-4f7a-42fc-9851-ad7ee28ce8b1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1517 microversion: 2.1 time: 0.156507 Jul 07 15:39:31.722659 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 405/818] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:31 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:31.853387 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2e0a2d75-aa64-4bc2-bace-dd040e79cf95 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "POST /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/action" status: 202 len: 0 microversion: 2.20 time: 0.261447 Jul 07 15:39:31.854148 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 414/819] 10.222.0.25 () {62 vars in 1318 bytes} [Thu Jul 7 15:39:31 2022] POST /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 07 15:39:31.862507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:31.863135 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:31.869316 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:31.869768 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:31.870538 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:31.870973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:32.004414 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:32.012445 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:32.014013 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:32.018110 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a61ca02b-9545-4145-b32f-9b69c0ebed09 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1671 microversion: 2.20 time: 0.156974 Jul 07 15:39:32.018110 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 406/820] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:31 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:32.740554 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e023c88c-cf77-4def-b9ef-8b7c64aa3fcb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:32.741170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e023c88c-cf77-4def-b9ef-8b7c64aa3fcb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:32.747297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e023c88c-cf77-4def-b9ef-8b7c64aa3fcb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:32.747783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e023c88c-cf77-4def-b9ef-8b7c64aa3fcb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:32.748549 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e023c88c-cf77-4def-b9ef-8b7c64aa3fcb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:32.748983 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e023c88c-cf77-4def-b9ef-8b7c64aa3fcb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:32.911986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e023c88c-cf77-4def-b9ef-8b7c64aa3fcb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:32.920006 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e023c88c-cf77-4def-b9ef-8b7c64aa3fcb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.184050 Jul 07 15:39:32.930329 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 415/821] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:32 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:33.033918 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:33.034517 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:33.041406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:33.041848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:33.042591 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:33.043017 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:33.175654 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:33.185020 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:33.186544 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:33.187741 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8e171f78-20d1-4de5-9f1e-6685ef53f182 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1671 microversion: 2.20 time: 0.157712 Jul 07 15:39:33.188433 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 407/822] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:33 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:33.936924 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7d433236-b616-4c34-89f4-8eaa57fe337b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:33.937521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7d433236-b616-4c34-89f4-8eaa57fe337b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:33.944618 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d433236-b616-4c34-89f4-8eaa57fe337b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:33.951451 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d433236-b616-4c34-89f4-8eaa57fe337b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:33.951451 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d433236-b616-4c34-89f4-8eaa57fe337b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:33.951451 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7d433236-b616-4c34-89f4-8eaa57fe337b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:34.081666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7d433236-b616-4c34-89f4-8eaa57fe337b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:34.090080 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7d433236-b616-4c34-89f4-8eaa57fe337b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.157077 Jul 07 15:39:34.090649 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 416/823] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:33 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:34.206281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:34.206897 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:34.209373 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:34.214108 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:34.218153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:34.218153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:34.218153 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:34.434037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:34.447708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:34.449280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:34.450505 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-72580328-531d-4dde-924d-3cd64197417e tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.248245 Jul 07 15:39:34.451064 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 408/824] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:34 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:35.112403 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3a92c5f1-1ec7-4312-93ec-0677a2df0f96 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:35.113005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3a92c5f1-1ec7-4312-93ec-0677a2df0f96 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:35.119801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a92c5f1-1ec7-4312-93ec-0677a2df0f96 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:35.120241 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a92c5f1-1ec7-4312-93ec-0677a2df0f96 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:35.120991 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a92c5f1-1ec7-4312-93ec-0677a2df0f96 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:35.121415 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a92c5f1-1ec7-4312-93ec-0677a2df0f96 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:35.265296 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3a92c5f1-1ec7-4312-93ec-0677a2df0f96 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:35.273091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3a92c5f1-1ec7-4312-93ec-0677a2df0f96 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.164810 Jul 07 15:39:35.282469 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 417/825] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:35 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:35.472319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:35.473384 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:35.485807 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:35.486275 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:35.487732 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:35.488358 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:35.668272 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:35.687372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:35.689031 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:35.690185 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a1c06ba8-592b-4251-aab0-167c652dc8f4 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.222460 Jul 07 15:39:35.700354 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 409/826] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:35 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:36.291075 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ceb3a7bb-2639-4791-a007-e25b6c89855b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:36.291679 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ceb3a7bb-2639-4791-a007-e25b6c89855b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:36.298712 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ceb3a7bb-2639-4791-a007-e25b6c89855b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:36.299217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ceb3a7bb-2639-4791-a007-e25b6c89855b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:36.299952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ceb3a7bb-2639-4791-a007-e25b6c89855b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:36.300389 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ceb3a7bb-2639-4791-a007-e25b6c89855b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:36.495689 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ceb3a7bb-2639-4791-a007-e25b6c89855b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:36.503709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ceb3a7bb-2639-4791-a007-e25b6c89855b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.217028 Jul 07 15:39:36.506489 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 418/827] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:36 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:36.718942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:36.719542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:36.736723 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:36.737304 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:36.738226 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:36.738909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:36.934334 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:36.943984 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:36.945816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:36.947003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-133f148e-4990-4b46-bbd3-12582d8d9444 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.231951 Jul 07 15:39:36.947590 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 410/828] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:36 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:37.522593 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9eb896ee-6936-4b98-8348-3610af361dff tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:37.524001 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9eb896ee-6936-4b98-8348-3610af361dff tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:37.531477 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9eb896ee-6936-4b98-8348-3610af361dff tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:37.532289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9eb896ee-6936-4b98-8348-3610af361dff tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:37.533471 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9eb896ee-6936-4b98-8348-3610af361dff tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:37.534003 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9eb896ee-6936-4b98-8348-3610af361dff tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:37.709488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9eb896ee-6936-4b98-8348-3610af361dff tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:37.721941 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9eb896ee-6936-4b98-8348-3610af361dff tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.201788 Jul 07 15:39:37.722874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 419/829] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:37 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:37.964639 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:37.966300 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:37.974210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:37.974659 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:37.975423 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:37.975996 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:38.135510 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:38.145926 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:38.147872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:38.150560 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a6924eb6-54b5-4cdb-893d-7ab0d6ed010c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.188978 Jul 07 15:39:38.151557 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 411/830] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:37 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:38.742503 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d3bc5f81-5855-4e55-97f9-8130d095f400 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:38.743828 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d3bc5f81-5855-4e55-97f9-8130d095f400 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:38.751208 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3bc5f81-5855-4e55-97f9-8130d095f400 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:38.751925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3bc5f81-5855-4e55-97f9-8130d095f400 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:38.753500 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3bc5f81-5855-4e55-97f9-8130d095f400 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:38.754088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d3bc5f81-5855-4e55-97f9-8130d095f400 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:38.929632 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d3bc5f81-5855-4e55-97f9-8130d095f400 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:38.936097 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d3bc5f81-5855-4e55-97f9-8130d095f400 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.200092 Jul 07 15:39:38.947000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 420/831] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:38 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:39.173528 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:39.174138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:39.182594 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:39.183053 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:39.184792 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:39.185583 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:39.372112 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:39.390014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:39.391688 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:39.392848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8930eecc-f7a3-45cf-898e-f07edd9e72ff tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.223695 Jul 07 15:39:39.408895 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 412/832] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:39 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:39.954180 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ee823acb-492d-48b4-93b2-18dc077edadc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:39.954741 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ee823acb-492d-48b4-93b2-18dc077edadc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:39.962120 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ee823acb-492d-48b4-93b2-18dc077edadc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:39.962620 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ee823acb-492d-48b4-93b2-18dc077edadc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:39.963397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ee823acb-492d-48b4-93b2-18dc077edadc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:39.963871 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ee823acb-492d-48b4-93b2-18dc077edadc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:40.133293 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ee823acb-492d-48b4-93b2-18dc077edadc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:40.140831 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ee823acb-492d-48b4-93b2-18dc077edadc tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.190805 Jul 07 15:39:40.141386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 421/833] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:39 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:40.416589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:40.416589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:40.422996 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:40.423439 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:40.424291 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:40.424998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:40.577312 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:40.587197 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:40.588832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:40.590268 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b36df0b4-0344-4e67-af3d-934f58a6350d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.182413 Jul 07 15:39:40.590820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 413/834] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:40 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:41.162202 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6fa78707-ffee-42aa-8481-329a4a6f07c8 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:41.163507 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6fa78707-ffee-42aa-8481-329a4a6f07c8 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:41.171383 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6fa78707-ffee-42aa-8481-329a4a6f07c8 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:41.171625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6fa78707-ffee-42aa-8481-329a4a6f07c8 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:41.172376 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6fa78707-ffee-42aa-8481-329a4a6f07c8 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:41.172916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6fa78707-ffee-42aa-8481-329a4a6f07c8 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:41.346053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6fa78707-ffee-42aa-8481-329a4a6f07c8 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:41.355875 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6fa78707-ffee-42aa-8481-329a4a6f07c8 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.198380 Jul 07 15:39:41.367420 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 422/835] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:41 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:41.612603 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:41.613256 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:41.620638 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:41.621657 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:41.622959 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:41.623742 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:41.766199 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:41.776364 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:41.778739 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:41.781430 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c7d77fcc-ec8e-4034-a549-9fa7e757f86b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.174244 Jul 07 15:39:41.782108 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 414/836] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:41 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:42.375899 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4e5848c9-49a7-4f5d-8ecb-b9505ca95652 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:42.377566 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4e5848c9-49a7-4f5d-8ecb-b9505ca95652 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:42.385795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e5848c9-49a7-4f5d-8ecb-b9505ca95652 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:42.386361 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e5848c9-49a7-4f5d-8ecb-b9505ca95652 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:42.387192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e5848c9-49a7-4f5d-8ecb-b9505ca95652 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:42.387657 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4e5848c9-49a7-4f5d-8ecb-b9505ca95652 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:42.535837 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4e5848c9-49a7-4f5d-8ecb-b9505ca95652 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:42.545125 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4e5848c9-49a7-4f5d-8ecb-b9505ca95652 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.174465 Jul 07 15:39:42.545886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 423/837] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:42 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:42.801625 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:42.802893 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:42.809941 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:42.810388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:42.811336 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:42.811957 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:42.969253 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:42.980357 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:42.981960 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:42.983796 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6d9d8b0b-d274-4ca6-9af6-a9b91de9e73b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.185940 Jul 07 15:39:42.984667 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 415/838] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:42 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:43.310422 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1152db2b-23fd-4218-a906-1aef6601b1ed tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:43.310844 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1152db2b-23fd-4218-a906-1aef6601b1ed tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:43.312772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=66 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:43.317649 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1152db2b-23fd-4218-a906-1aef6601b1ed tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:43.318093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1152db2b-23fd-4218-a906-1aef6601b1ed tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:43.318849 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1152db2b-23fd-4218-a906-1aef6601b1ed tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:43.319281 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1152db2b-23fd-4218-a906-1aef6601b1ed tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:43.344574 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1152db2b-23fd-4218-a906-1aef6601b1ed tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:39:43.562428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-24c54a3a-467a-46db-9d54-be703972275a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:43.562950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-24c54a3a-467a-46db-9d54-be703972275a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:43.570696 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-24c54a3a-467a-46db-9d54-be703972275a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:43.571156 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-24c54a3a-467a-46db-9d54-be703972275a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:43.571969 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-24c54a3a-467a-46db-9d54-be703972275a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:43.572399 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-24c54a3a-467a-46db-9d54-be703972275a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:43.720942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-24c54a3a-467a-46db-9d54-be703972275a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:43.729978 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-24c54a3a-467a-46db-9d54-be703972275a tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.171345 Jul 07 15:39:43.730664 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 416/839] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:43 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:43.857062 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1152db2b-23fd-4218-a906-1aef6601b1ed tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "DELETE /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 204 len: 0 microversion: 2.1 time: 0.550297 Jul 07 15:39:43.857651 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 424/840] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:39:43 2022] DELETE /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:39:43.866673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-55ff5022-9937-4d6d-b4bc-9b31efe063fb tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:43.867280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-55ff5022-9937-4d6d-b4bc-9b31efe063fb tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:43.874350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55ff5022-9937-4d6d-b4bc-9b31efe063fb tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:43.874804 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55ff5022-9937-4d6d-b4bc-9b31efe063fb tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:43.875592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55ff5022-9937-4d6d-b4bc-9b31efe063fb tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:43.876028 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55ff5022-9937-4d6d-b4bc-9b31efe063fb tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:44.003421 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:44.004346 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:44.011466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:44.011751 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:44.012245 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-55ff5022-9937-4d6d-b4bc-9b31efe063fb tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:44.012521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:44.012957 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:44.019952 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-55ff5022-9937-4d6d-b4bc-9b31efe063fb tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1573 microversion: 2.1 time: 0.157658 Jul 07 15:39:44.020596 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 417/841] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:43 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:44.145227 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:44.153020 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:44.154517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:44.155692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ba102db3-37f5-4bf4-888e-d8dd250ed928 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.156538 Jul 07 15:39:44.156229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 425/842] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:43 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:44.747896 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-66f074e3-0a10-438c-b06b-b598e617cbaa tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:44.748526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-66f074e3-0a10-438c-b06b-b598e617cbaa tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:44.754528 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66f074e3-0a10-438c-b06b-b598e617cbaa tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:44.754967 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66f074e3-0a10-438c-b06b-b598e617cbaa tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:44.755744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66f074e3-0a10-438c-b06b-b598e617cbaa tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:44.756175 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66f074e3-0a10-438c-b06b-b598e617cbaa tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:44.882180 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-66f074e3-0a10-438c-b06b-b598e617cbaa tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:44.889557 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-66f074e3-0a10-438c-b06b-b598e617cbaa tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.145494 Jul 07 15:39:44.890111 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 418/843] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:44 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:45.037445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-76d11648-2e27-46a5-963f-b60b5f513d7d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:45.037959 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-76d11648-2e27-46a5-963f-b60b5f513d7d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:45.044539 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-76d11648-2e27-46a5-963f-b60b5f513d7d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:45.044876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-76d11648-2e27-46a5-963f-b60b5f513d7d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:45.045622 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-76d11648-2e27-46a5-963f-b60b5f513d7d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:45.046051 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-76d11648-2e27-46a5-963f-b60b5f513d7d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:45.173977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:45.174578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:45.174697 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-76d11648-2e27-46a5-963f-b60b5f513d7d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:45.180709 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:45.181156 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:45.182029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:45.182206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-76d11648-2e27-46a5-963f-b60b5f513d7d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1573 microversion: 2.1 time: 0.148635 Jul 07 15:39:45.182469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:45.182801 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 426/844] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:45 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:45.186392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:45.315851 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:45.324606 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:45.326172 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:45.327334 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e24a6c59-fcee-4482-a562-3f3a4c7cdf39 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.157210 Jul 07 15:39:45.327929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 419/845] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:45 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:45.907033 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a923bb08-929f-4896-abd6-58b53307048e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:45.907666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a923bb08-929f-4896-abd6-58b53307048e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:45.914147 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a923bb08-929f-4896-abd6-58b53307048e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:45.914591 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a923bb08-929f-4896-abd6-58b53307048e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:45.915345 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a923bb08-929f-4896-abd6-58b53307048e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:45.915813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a923bb08-929f-4896-abd6-58b53307048e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:45.919820 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:46.048834 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-a923bb08-929f-4896-abd6-58b53307048e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:46.056292 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a923bb08-929f-4896-abd6-58b53307048e tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.153149 Jul 07 15:39:46.056856 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 427/846] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:45 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:46.199537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2f53c492-dd17-4675-8b0e-6ec02545406c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:46.201882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2f53c492-dd17-4675-8b0e-6ec02545406c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:46.206727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2f53c492-dd17-4675-8b0e-6ec02545406c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:46.207168 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2f53c492-dd17-4675-8b0e-6ec02545406c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:46.208754 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2f53c492-dd17-4675-8b0e-6ec02545406c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:46.208980 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2f53c492-dd17-4675-8b0e-6ec02545406c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:46.347336 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2f53c492-dd17-4675-8b0e-6ec02545406c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:46.347545 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:46.348430 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:46.355620 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2f53c492-dd17-4675-8b0e-6ec02545406c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1573 microversion: 2.1 time: 0.159880 Jul 07 15:39:46.356205 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 420/847] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:46 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:46.361698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:46.368424 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:46.368424 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:46.368424 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:46.493174 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:46.505714 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:46.507275 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:46.508476 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1824650b-898d-47bd-8436-f968182522a9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.165186 Jul 07 15:39:46.509034 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 428/848] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:46 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:47.073652 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-25144058-be30-4ba6-a2d1-cae44513d00b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:47.074206 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-25144058-be30-4ba6-a2d1-cae44513d00b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:47.080259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-25144058-be30-4ba6-a2d1-cae44513d00b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:47.080698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-25144058-be30-4ba6-a2d1-cae44513d00b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:47.081443 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-25144058-be30-4ba6-a2d1-cae44513d00b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:47.081867 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-25144058-be30-4ba6-a2d1-cae44513d00b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:47.210351 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-25144058-be30-4ba6-a2d1-cae44513d00b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:47.217719 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-25144058-be30-4ba6-a2d1-cae44513d00b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.148042 Jul 07 15:39:47.218330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 421/849] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:47 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:47.372175 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-271165fc-eb85-48d4-9d05-157687b98e1b tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:47.372775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-271165fc-eb85-48d4-9d05-157687b98e1b tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:47.379158 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-271165fc-eb85-48d4-9d05-157687b98e1b tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:47.379625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-271165fc-eb85-48d4-9d05-157687b98e1b tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:47.380382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-271165fc-eb85-48d4-9d05-157687b98e1b tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:47.380807 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-271165fc-eb85-48d4-9d05-157687b98e1b tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:47.527383 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:47.528039 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:47.528277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-271165fc-eb85-48d4-9d05-157687b98e1b tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:47.534029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:47.534501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:47.535242 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:47.535705 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:47.535834 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-271165fc-eb85-48d4-9d05-157687b98e1b tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1573 microversion: 2.1 time: 0.167386 Jul 07 15:39:47.536875 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 429/850] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:47 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:47.662877 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:47.670691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:47.672368 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:47.673512 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-46f94944-82e9-47ba-a087-d3b498eb8789 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.150305 Jul 07 15:39:47.674071 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 422/851] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:47 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:48.235309 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d91c612c-b062-4fa6-8752-4773388f8218 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:48.235877 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d91c612c-b062-4fa6-8752-4773388f8218 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:48.241880 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d91c612c-b062-4fa6-8752-4773388f8218 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:48.242325 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d91c612c-b062-4fa6-8752-4773388f8218 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:48.243081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d91c612c-b062-4fa6-8752-4773388f8218 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:48.243508 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d91c612c-b062-4fa6-8752-4773388f8218 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:48.375064 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d91c612c-b062-4fa6-8752-4773388f8218 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:48.383684 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d91c612c-b062-4fa6-8752-4773388f8218 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.152512 Jul 07 15:39:48.384254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 430/852] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:48 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:48.554317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-33491014-ed1b-4dc5-ac41-c21ac32e0401 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:48.554955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-33491014-ed1b-4dc5-ac41-c21ac32e0401 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:48.562000 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33491014-ed1b-4dc5-ac41-c21ac32e0401 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:48.562455 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33491014-ed1b-4dc5-ac41-c21ac32e0401 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:48.563257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33491014-ed1b-4dc5-ac41-c21ac32e0401 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:48.563731 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-33491014-ed1b-4dc5-ac41-c21ac32e0401 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:48.692049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:48.692745 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:48.695021 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-33491014-ed1b-4dc5-ac41-c21ac32e0401 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:48.698875 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:48.699326 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:48.700336 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:48.700806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:48.702652 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-33491014-ed1b-4dc5-ac41-c21ac32e0401 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1573 microversion: 2.1 time: 0.153101 Jul 07 15:39:48.703216 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 423/853] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:48 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:48.831621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:48.839487 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:48.841031 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:48.842184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e4532004-9a43-4944-8e81-9b95533c2579 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.154479 Jul 07 15:39:48.842770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 431/854] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:48 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:49.400392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c1821d63-0feb-4c89-b55a-c42bfd1a25d7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:49.402088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c1821d63-0feb-4c89-b55a-c42bfd1a25d7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:49.408035 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1821d63-0feb-4c89-b55a-c42bfd1a25d7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:49.408474 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1821d63-0feb-4c89-b55a-c42bfd1a25d7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:49.409222 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1821d63-0feb-4c89-b55a-c42bfd1a25d7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:49.409648 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c1821d63-0feb-4c89-b55a-c42bfd1a25d7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:49.553992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c1821d63-0feb-4c89-b55a-c42bfd1a25d7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:49.562076 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c1821d63-0feb-4c89-b55a-c42bfd1a25d7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.165499 Jul 07 15:39:49.562654 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 424/855] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:49 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:49.726137 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-eef30a4e-01e2-4491-9ca9-cdbaf1216195 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:49.726672 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-eef30a4e-01e2-4491-9ca9-cdbaf1216195 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:49.732809 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eef30a4e-01e2-4491-9ca9-cdbaf1216195 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:49.733250 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eef30a4e-01e2-4491-9ca9-cdbaf1216195 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:49.734004 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eef30a4e-01e2-4491-9ca9-cdbaf1216195 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:49.734433 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eef30a4e-01e2-4491-9ca9-cdbaf1216195 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:49.860443 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:49.861044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:49.867008 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-eef30a4e-01e2-4491-9ca9-cdbaf1216195 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:49.869352 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:49.869352 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:49.869352 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:49.869352 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:49.874710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-eef30a4e-01e2-4491-9ca9-cdbaf1216195 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1573 microversion: 2.1 time: 0.152374 Jul 07 15:39:49.875286 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 432/856] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:49 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:50.001746 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:50.010128 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:50.011686 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:50.012819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-855a6e23-bd43-4932-8e64-d2568b44e91c tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.156740 Jul 07 15:39:50.013369 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 425/857] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:49 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:50.578599 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-df63c4a7-7e3a-4461-86b0-2fec290e789b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:50.582332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-df63c4a7-7e3a-4461-86b0-2fec290e789b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:50.586825 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df63c4a7-7e3a-4461-86b0-2fec290e789b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:50.587515 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df63c4a7-7e3a-4461-86b0-2fec290e789b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:50.588387 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df63c4a7-7e3a-4461-86b0-2fec290e789b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:50.589364 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df63c4a7-7e3a-4461-86b0-2fec290e789b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:50.723854 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-df63c4a7-7e3a-4461-86b0-2fec290e789b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:50.731377 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-df63c4a7-7e3a-4461-86b0-2fec290e789b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.156554 Jul 07 15:39:50.731970 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 433/858] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:50 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:50.892296 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3cc9d5e3-24d8-452e-b538-014bfdc0c353 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:50.893060 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3cc9d5e3-24d8-452e-b538-014bfdc0c353 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:50.899423 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3cc9d5e3-24d8-452e-b538-014bfdc0c353 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:50.899928 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3cc9d5e3-24d8-452e-b538-014bfdc0c353 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:50.900677 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3cc9d5e3-24d8-452e-b538-014bfdc0c353 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:50.901101 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3cc9d5e3-24d8-452e-b538-014bfdc0c353 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:51.030956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:51.031774 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:51.042619 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:51.042770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3cc9d5e3-24d8-452e-b538-014bfdc0c353 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:51.042887 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:51.042887 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:51.042887 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:51.048630 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3cc9d5e3-24d8-452e-b538-014bfdc0c353 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1573 microversion: 2.1 time: 0.160178 Jul 07 15:39:51.049200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 426/859] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:50 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:51.242957 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:51.251163 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:51.252699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:51.253851 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9f307517-94e0-4bd9-8f92-b537fb383c01 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.226973 Jul 07 15:39:51.254448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 434/860] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:51 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:51.545379 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7dbf7864-e8d3-447a-b393-6624927d7dd3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:51.546424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7dbf7864-e8d3-447a-b393-6624927d7dd3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:51.552567 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7dbf7864-e8d3-447a-b393-6624927d7dd3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:51.553013 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7dbf7864-e8d3-447a-b393-6624927d7dd3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:51.553780 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7dbf7864-e8d3-447a-b393-6624927d7dd3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:51.554215 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7dbf7864-e8d3-447a-b393-6624927d7dd3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:51.583702 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7dbf7864-e8d3-447a-b393-6624927d7dd3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 Jul 07 15:39:51.584261 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 427/861] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:39:51 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:51.594134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-91bb46e9-305f-4794-8d26-18016626a8b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:51.594750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-91bb46e9-305f-4794-8d26-18016626a8b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:51.601682 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-91bb46e9-305f-4794-8d26-18016626a8b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:51.602130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-91bb46e9-305f-4794-8d26-18016626a8b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:51.602891 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-91bb46e9-305f-4794-8d26-18016626a8b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:51.603351 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-91bb46e9-305f-4794-8d26-18016626a8b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:51.635968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-91bb46e9-305f-4794-8d26-18016626a8b7 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/59390504-35ba-4d92-b305-24fc821caf36" status: 200 len: 194 microversion: 2.1 time: 0.045705 Jul 07 15:39:51.637186 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 435/862] 10.222.0.25 () {58 vars in 1412 bytes} [Thu Jul 7 15:39:51 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/59390504-35ba-4d92-b305-24fc821caf36 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:51.748755 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cc12be36-2d96-4d24-a368-6badf8b823fd tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:51.749417 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cc12be36-2d96-4d24-a368-6badf8b823fd tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:51.759438 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cc12be36-2d96-4d24-a368-6badf8b823fd tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:51.759438 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cc12be36-2d96-4d24-a368-6badf8b823fd tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:51.759438 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cc12be36-2d96-4d24-a368-6badf8b823fd tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:51.760329 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cc12be36-2d96-4d24-a368-6badf8b823fd tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:51.969018 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cc12be36-2d96-4d24-a368-6badf8b823fd tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:51.978338 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cc12be36-2d96-4d24-a368-6badf8b823fd tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.233506 Jul 07 15:39:51.979093 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 428/863] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:51 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:52.066585 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f5e7d21b-abd1-4507-a2bb-aff9c88b510c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:52.073046 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f5e7d21b-abd1-4507-a2bb-aff9c88b510c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:52.074446 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5e7d21b-abd1-4507-a2bb-aff9c88b510c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:52.074892 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5e7d21b-abd1-4507-a2bb-aff9c88b510c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:52.076916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5e7d21b-abd1-4507-a2bb-aff9c88b510c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:52.076916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5e7d21b-abd1-4507-a2bb-aff9c88b510c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:52.116054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-2732f9c3-7d68-415f-ac0d-e63648cfa212 req-b8db972e-f678-43e0-89d2-e8cdacf1f52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32392277-48d3-4a76-8afe-0df0a333ef33", "name": "network-vif-deleted", "tag": "35593a8e-da9a-44a7-a403-00fa6a1c1cef"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:52.124755 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-2732f9c3-7d68-415f-ac0d-e63648cfa212 req-b8db972e-f678-43e0-89d2-e8cdacf1f52f service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:52.127196 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-2732f9c3-7d68-415f-ac0d-e63648cfa212 req-b8db972e-f678-43e0-89d2-e8cdacf1f52f service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:52.147779 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-2732f9c3-7d68-415f-ac0d-e63648cfa212 req-b8db972e-f678-43e0-89d2-e8cdacf1f52f service nova] Creating event network-vif-deleted:35593a8e-da9a-44a7-a403-00fa6a1c1cef for instance 32392277-48d3-4a76-8afe-0df0a333ef33 on hv-cinder-84130 Jul 07 15:39:52.153091 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f5e7d21b-abd1-4507-a2bb-aff9c88b510c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:52.155876 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-2732f9c3-7d68-415f-ac0d-e63648cfa212 req-b8db972e-f678-43e0-89d2-e8cdacf1f52f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043041 Jul 07 15:39:52.155876 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 429/864] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:52.169133 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f5e7d21b-abd1-4507-a2bb-aff9c88b510c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1505 microversion: 2.1 time: 0.106254 Jul 07 15:39:52.170347 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 436/865] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:52 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1505 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:52.275826 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:52.275826 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:52.280017 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:52.280474 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:52.281253 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:52.281693 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:52.647068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:52.655077 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:52.656623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:52.657781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c3e6b70d-0fe3-4269-a63b-c49f541aa8ae tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.389557 Jul 07 15:39:52.658341 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 430/866] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:52 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:52.995739 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0d8e667c-0ebd-43c8-b167-e7133b798c34 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:52.996349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0d8e667c-0ebd-43c8-b167-e7133b798c34 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:53.002438 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d8e667c-0ebd-43c8-b167-e7133b798c34 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:53.002882 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d8e667c-0ebd-43c8-b167-e7133b798c34 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:53.003683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d8e667c-0ebd-43c8-b167-e7133b798c34 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:53.004144 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0d8e667c-0ebd-43c8-b167-e7133b798c34 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:53.138935 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0d8e667c-0ebd-43c8-b167-e7133b798c34 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:53.147115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0d8e667c-0ebd-43c8-b167-e7133b798c34 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.155315 Jul 07 15:39:53.147780 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 437/867] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:52 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:53.188961 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c935880e-5a39-4eff-8640-1b4bd5869a27 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:53.188961 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c935880e-5a39-4eff-8640-1b4bd5869a27 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:53.197963 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c935880e-5a39-4eff-8640-1b4bd5869a27 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:53.198414 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c935880e-5a39-4eff-8640-1b4bd5869a27 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:53.199184 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c935880e-5a39-4eff-8640-1b4bd5869a27 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:53.199641 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c935880e-5a39-4eff-8640-1b4bd5869a27 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:53.273054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c935880e-5a39-4eff-8640-1b4bd5869a27 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:53.282010 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c935880e-5a39-4eff-8640-1b4bd5869a27 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1505 microversion: 2.1 time: 0.098579 Jul 07 15:39:53.282973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 431/868] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:53 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1505 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:39:53.676955 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:53.677487 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:53.683473 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:53.683957 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:53.684710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:53.685138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:53.812269 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:53.820822 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:53.822324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:53.823474 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d0b57e0f-6438-4f37-9d40-1a242266d848 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.151029 Jul 07 15:39:53.824070 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 438/869] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:53 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:54.164955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-68bd5aa3-5979-4842-8157-3cf432d7461d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:54.165988 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-68bd5aa3-5979-4842-8157-3cf432d7461d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:54.172334 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-68bd5aa3-5979-4842-8157-3cf432d7461d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:54.173214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-68bd5aa3-5979-4842-8157-3cf432d7461d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:54.173880 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-68bd5aa3-5979-4842-8157-3cf432d7461d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:54.174482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-68bd5aa3-5979-4842-8157-3cf432d7461d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:54.300080 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b513bdeb-a414-43a0-b096-7989f2ea4e4e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:54.300790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b513bdeb-a414-43a0-b096-7989f2ea4e4e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:54.307958 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b513bdeb-a414-43a0-b096-7989f2ea4e4e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:54.308490 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b513bdeb-a414-43a0-b096-7989f2ea4e4e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:54.309333 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b513bdeb-a414-43a0-b096-7989f2ea4e4e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:54.309865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b513bdeb-a414-43a0-b096-7989f2ea4e4e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:54.379111 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b513bdeb-a414-43a0-b096-7989f2ea4e4e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:54.386782 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b513bdeb-a414-43a0-b096-7989f2ea4e4e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1222 microversion: 2.1 time: 0.090946 Jul 07 15:39:54.387367 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 439/870] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:54 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:39:54.477104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-68bd5aa3-5979-4842-8157-3cf432d7461d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:54.486111 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-68bd5aa3-5979-4842-8157-3cf432d7461d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.325690 Jul 07 15:39:54.486685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 432/871] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:54 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:54.755614 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9b5ea5f6-e66f-47ea-939f-baf75ef29a5c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca444736-cd3e-46e8-a68c-995f1d2d7cc7"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:54.755614 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9b5ea5f6-e66f-47ea-939f-baf75ef29a5c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:54.760243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b5ea5f6-e66f-47ea-939f-baf75ef29a5c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:54.760998 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b5ea5f6-e66f-47ea-939f-baf75ef29a5c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:54.762561 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b5ea5f6-e66f-47ea-939f-baf75ef29a5c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:54.763254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9b5ea5f6-e66f-47ea-939f-baf75ef29a5c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:54.842211 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:54.842915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:54.852278 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:54.852971 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:54.853791 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:54.854246 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:55.010077 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:55.019113 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:55.021224 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:55.024492 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9f3d0bce-4ffd-471e-ad73-b557d6dc34e5 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.184905 Jul 07 15:39:55.025659 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 433/872] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:54 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:55.404643 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:55.405450 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:55.413901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:55.414540 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:55.415348 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:55.415800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:55.457096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:55.457096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:55.457096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lazy-loading 'fault' on Instance uuid 32392277-48d3-4a76-8afe-0df0a333ef33 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:39:55.509338 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:55.516813 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-593abdc0-5427-4e96-b4a3-18657d2afd47 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 200 len: 1227 microversion: 2.1 time: 0.115876 Jul 07 15:39:55.517394 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 434/873] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:55 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 1227 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:39:55.521845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6d4e2358-b17f-4f8a-8105-43ec7a997947 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:55.522442 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6d4e2358-b17f-4f8a-8105-43ec7a997947 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:55.528537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d4e2358-b17f-4f8a-8105-43ec7a997947 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:55.529055 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d4e2358-b17f-4f8a-8105-43ec7a997947 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:55.529832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d4e2358-b17f-4f8a-8105-43ec7a997947 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:55.530262 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6d4e2358-b17f-4f8a-8105-43ec7a997947 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:55.671139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6d4e2358-b17f-4f8a-8105-43ec7a997947 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:55.679235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6d4e2358-b17f-4f8a-8105-43ec7a997947 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.160921 Jul 07 15:39:55.679830 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 435/874] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:55 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:55.876577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9b5ea5f6-e66f-47ea-939f-baf75ef29a5c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "POST /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.128876 Jul 07 15:39:55.877302 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 440/875] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:39:54 2022] POST /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments => generated 194 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:56.044442 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:56.044964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:56.050904 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:56.051354 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:56.052141 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:56.052575 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:56.056629 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:56.181030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:56.189009 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:56.190554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:56.191768 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8ccfa26b-7946-4a11-8649-ab3a78cd202d tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.151325 Jul 07 15:39:56.192859 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 436/876] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:56 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:56.278958 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-232ef54e-6cba-4afb-9c7f-9404eaa3d1f8 req-0f971caf-4ced-4f6b-b240-a874e9206658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cfd6f9-be72-41c0-8887-1425b3f5565c", "name": "network-vif-plugged", "status": "completed", "tag": "cd19f05f-6752-480d-a56b-5d74f03e8e3a"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:56.287205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-232ef54e-6cba-4afb-9c7f-9404eaa3d1f8 req-0f971caf-4ced-4f6b-b240-a874e9206658 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:56.287660 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-232ef54e-6cba-4afb-9c7f-9404eaa3d1f8 req-0f971caf-4ced-4f6b-b240-a874e9206658 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:56.298699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-232ef54e-6cba-4afb-9c7f-9404eaa3d1f8 req-0f971caf-4ced-4f6b-b240-a874e9206658 service nova] Creating event network-vif-plugged:cd19f05f-6752-480d-a56b-5d74f03e8e3a for instance d8cfd6f9-be72-41c0-8887-1425b3f5565c on hv-cinder-84130 Jul 07 15:39:56.303557 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-232ef54e-6cba-4afb-9c7f-9404eaa3d1f8 req-0f971caf-4ced-4f6b-b240-a874e9206658 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028777 Jul 07 15:39:56.304328 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 441/877] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:39:56.534067 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:56.534686 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:56.541348 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:56.541806 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:56.542567 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:56.543003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:56.556689 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] HTTP exception thrown: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Request method failure captured: Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 HTTP/1.1 Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv2QBV1I8w1TkM9ctiY1d6US8ZrjKh8NBeDoZU9A_t-HOeq0i8yywrMjxh96-1M2y7HshcGyGet4c2m-aNx5O07GBQ47EjI5PRoO5EsELzYabLG4HbXsvgq2jKygLB1ZoDt6c8-9NsctnCRg6LBEvEVMYz-9JUHzUsV-_DE-v3UMcmI Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:39:56.558405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b72dae7a2e644460b4c63da884023c82", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 05e0f1ddeb224677b18cfc769dc45d47 Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:39:56.563054 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '32392277-48d3-4a76-8afe-0df0a333ef33'} Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:39:56.563992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:39:56.565299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:39:56.566626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Returning 404 to user: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:39:56.566626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-71c35a7d-e2d8-489c-9e4b-21fcc1c84733 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 404 len: 111 microversion: 2.1 time: 0.029708 Jul 07 15:39:56.566626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 437/878] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:56 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:39:56.656885 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-553491127", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-92263573", "security_groups": [{"name": "tempest-secgroup-smoke-1899091157"}], "block_device_mapping_v2": [{"uuid": "7535f083-cc46-4d16-a19d-5dc3c3bd44a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29820a51-47ed-4a8e-8170-71221aa2cdfe"}]}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:39:56.698211 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d8876733-be65-42b3-bbb9-a42514522f03 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:56.698841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d8876733-be65-42b3-bbb9-a42514522f03 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:56.705868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d8876733-be65-42b3-bbb9-a42514522f03 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:56.706324 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d8876733-be65-42b3-bbb9-a42514522f03 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:56.707759 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d8876733-be65-42b3-bbb9-a42514522f03 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:56.708168 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d8876733-be65-42b3-bbb9-a42514522f03 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:56.819935 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.network.neutron [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] validate_networks() for [('29820a51-47ed-4a8e-8170-71221aa2cdfe', None, None, None, None, None)] {{(pid=124719) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:39:56.931414 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d8876733-be65-42b3-bbb9-a42514522f03 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:56.950073 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d8876733-be65-42b3-bbb9-a42514522f03 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.257523 Jul 07 15:39:56.954172 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 438/879] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:56 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:57.210623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:57.211227 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:57.217691 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:57.218886 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:57.219979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:57.220406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:57.250473 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Flavor limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:39:57.251093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Image limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:39:57.251799 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Flavor pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:39:57.258086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Image pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:39:57.258086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:39:57.261752 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:57.262199 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:57.262995 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:57.263425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:57.280834 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Getting quotas for project b72dae7a2e644460b4c63da884023c82. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:39:57.284802 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Getting quotas for user 05e0f1ddeb224677b18cfc769dc45d47 and project b72dae7a2e644460b4c63da884023c82. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:39:57.341944 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Going to run 1 instances... {{(pid=124719) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:39:57.344116 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7535f083-cc46-4d16-a19d-5dc3c3bd44a8',volume_size=None,volume_type=None)] {{(pid=124719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:39:57.356440 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:57.365346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:57.366754 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:57.367951 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-99f83204-d449-47fd-8834-d7503b25a70b tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.161368 Jul 07 15:39:57.368497 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 439/880] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:57 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:39:57.748044 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-80f51c29-716b-4179-ac2e-28cbf563262f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.095823 Jul 07 15:39:57.748684 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 442/881] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:39:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:39:57.759350 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e56be2c5-d5eb-4b74-8b79-c116172103fc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:57.759982 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e56be2c5-d5eb-4b74-8b79-c116172103fc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:57.812755 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e56be2c5-d5eb-4b74-8b79-c116172103fc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:57.820113 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e56be2c5-d5eb-4b74-8b79-c116172103fc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1092 microversion: 2.1 time: 0.064585 Jul 07 15:39:57.820571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 440/882] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:57 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:57.966359 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d2502cc6-ff74-4143-bb78-e7cbf2259b91 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:57.967113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d2502cc6-ff74-4143-bb78-e7cbf2259b91 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:57.974278 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d2502cc6-ff74-4143-bb78-e7cbf2259b91 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:57.979519 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d2502cc6-ff74-4143-bb78-e7cbf2259b91 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:57.979519 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d2502cc6-ff74-4143-bb78-e7cbf2259b91 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:57.979519 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d2502cc6-ff74-4143-bb78-e7cbf2259b91 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:58.164145 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d2502cc6-ff74-4143-bb78-e7cbf2259b91 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:58.170631 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:39:58.173161 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d2502cc6-ff74-4143-bb78-e7cbf2259b91 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.210827 Jul 07 15:39:58.174055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 443/883] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:57 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:58.386518 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:58.387127 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:58.393205 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:58.393649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:58.394455 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:58.394842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:58.577525 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:58.586017 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:58.587620 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:58.591501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2fd63cac-af7d-4ae8-905b-df4cec1097aa tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1729 microversion: 2.20 time: 0.206348 Jul 07 15:39:58.591501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 441/884] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:58 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:58.837067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-252b3243-2f60-480e-a4d0-7bb3c77c17b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:58.837795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-252b3243-2f60-480e-a4d0-7bb3c77c17b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:58.845338 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-252b3243-2f60-480e-a4d0-7bb3c77c17b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:58.845784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-252b3243-2f60-480e-a4d0-7bb3c77c17b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:58.846549 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-252b3243-2f60-480e-a4d0-7bb3c77c17b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:58.846981 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-252b3243-2f60-480e-a4d0-7bb3c77c17b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:58.908520 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-252b3243-2f60-480e-a4d0-7bb3c77c17b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:58.916975 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-252b3243-2f60-480e-a4d0-7bb3c77c17b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1142 microversion: 2.1 time: 0.084251 Jul 07 15:39:58.917548 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 444/885] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:58 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:59.248106 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-de958c42-ee2e-44ce-a268-b8b6cd2af5d1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:59.248639 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-de958c42-ee2e-44ce-a268-b8b6cd2af5d1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:59.255347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-de958c42-ee2e-44ce-a268-b8b6cd2af5d1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:59.255889 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-de958c42-ee2e-44ce-a268-b8b6cd2af5d1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:59.256656 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-de958c42-ee2e-44ce-a268-b8b6cd2af5d1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:59.257091 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-de958c42-ee2e-44ce-a268-b8b6cd2af5d1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:59.393683 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-de958c42-ee2e-44ce-a268-b8b6cd2af5d1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:59.401391 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-de958c42-ee2e-44ce-a268-b8b6cd2af5d1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.157245 Jul 07 15:39:59.401950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 442/886] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:59 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:39:59.611170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:59.613454 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:59.619975 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:59.620419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:59.621174 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:59.621598 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:59.755493 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:59.764021 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:59.765716 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:39:59.766951 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e9c5682c-e7d1-4843-ba07-81b97fa43d9a tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1716 microversion: 2.20 time: 0.162566 Jul 07 15:39:59.767502 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 445/887] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:39:59 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:39:59.934230 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f0711b8c-5da0-44fc-a0a4-007be561331c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:39:59.934840 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f0711b8c-5da0-44fc-a0a4-007be561331c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:39:59.941417 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f0711b8c-5da0-44fc-a0a4-007be561331c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:59.942327 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f0711b8c-5da0-44fc-a0a4-007be561331c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:39:59.943108 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f0711b8c-5da0-44fc-a0a4-007be561331c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:39:59.943543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f0711b8c-5da0-44fc-a0a4-007be561331c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:00.019614 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f0711b8c-5da0-44fc-a0a4-007be561331c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:00.027977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f0711b8c-5da0-44fc-a0a4-007be561331c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1198 microversion: 2.1 time: 0.097648 Jul 07 15:40:00.028542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 443/888] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:39:59 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:00.418321 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-86a7d008-1731-4077-9ee0-9a611f9b430f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:00.418921 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-86a7d008-1731-4077-9ee0-9a611f9b430f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:00.425918 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-86a7d008-1731-4077-9ee0-9a611f9b430f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:00.426897 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-86a7d008-1731-4077-9ee0-9a611f9b430f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:00.427705 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-86a7d008-1731-4077-9ee0-9a611f9b430f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:00.428136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-86a7d008-1731-4077-9ee0-9a611f9b430f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:00.616765 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-86a7d008-1731-4077-9ee0-9a611f9b430f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:00.624368 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-86a7d008-1731-4077-9ee0-9a611f9b430f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.210032 Jul 07 15:40:00.624937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 446/889] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:00 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:01.047966 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fd5e4298-2589-4ab1-b998-927c5a1f0231 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:01.048816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fd5e4298-2589-4ab1-b998-927c5a1f0231 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:01.055851 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fd5e4298-2589-4ab1-b998-927c5a1f0231 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:01.056298 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fd5e4298-2589-4ab1-b998-927c5a1f0231 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:01.057058 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fd5e4298-2589-4ab1-b998-927c5a1f0231 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:01.057623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fd5e4298-2589-4ab1-b998-927c5a1f0231 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:01.298998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fd5e4298-2589-4ab1-b998-927c5a1f0231 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:01.307678 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fd5e4298-2589-4ab1-b998-927c5a1f0231 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.264768 Jul 07 15:40:01.311629 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 444/890] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:01 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:01.642845 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c663672d-059b-4c8a-8265-0bd5027d533f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:01.644265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c663672d-059b-4c8a-8265-0bd5027d533f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:01.651287 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c663672d-059b-4c8a-8265-0bd5027d533f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:01.652016 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c663672d-059b-4c8a-8265-0bd5027d533f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:01.653012 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c663672d-059b-4c8a-8265-0bd5027d533f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:01.653955 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c663672d-059b-4c8a-8265-0bd5027d533f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:01.858996 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c663672d-059b-4c8a-8265-0bd5027d533f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:01.869751 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c663672d-059b-4c8a-8265-0bd5027d533f tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1519 microversion: 2.1 time: 0.231663 Jul 07 15:40:01.870619 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 447/891] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:01 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:02.033185 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-b925ee03-c76f-4f82-8dee-2cd2954c5a14 req-f94a1e9e-f3f2-415d-a302-9347bf8b33f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3287e24c-ce40-4bc8-95ac-3361e15b5807", "tag": "697451eb-ff82-4b0c-b64d-5fb8cde5a13f"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:40:02.046200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-b925ee03-c76f-4f82-8dee-2cd2954c5a14 req-f94a1e9e-f3f2-415d-a302-9347bf8b33f9 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:02.046200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-b925ee03-c76f-4f82-8dee-2cd2954c5a14 req-f94a1e9e-f3f2-415d-a302-9347bf8b33f9 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:02.071630 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-b925ee03-c76f-4f82-8dee-2cd2954c5a14 req-f94a1e9e-f3f2-415d-a302-9347bf8b33f9 service nova] Creating event network-changed:697451eb-ff82-4b0c-b64d-5fb8cde5a13f for instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 on hv-cinder-84130 Jul 07 15:40:02.079710 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-b925ee03-c76f-4f82-8dee-2cd2954c5a14 req-f94a1e9e-f3f2-415d-a302-9347bf8b33f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053434 Jul 07 15:40:02.080604 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 445/892] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:02.326636 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3b49920d-a835-42f3-bcd9-ffccc96ad2d7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:02.327514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3b49920d-a835-42f3-bcd9-ffccc96ad2d7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:02.340923 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b49920d-a835-42f3-bcd9-ffccc96ad2d7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:02.341727 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b49920d-a835-42f3-bcd9-ffccc96ad2d7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:02.344806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b49920d-a835-42f3-bcd9-ffccc96ad2d7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:02.345799 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3b49920d-a835-42f3-bcd9-ffccc96ad2d7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:02.566506 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-2cca973f-6509-4291-a9fe-d0bfbf589bdf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:02.569685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-2cca973f-6509-4291-a9fe-d0bfbf589bdf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:02.573223 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3b49920d-a835-42f3-bcd9-ffccc96ad2d7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:02.577289 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2cca973f-6509-4291-a9fe-d0bfbf589bdf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:02.577783 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2cca973f-6509-4291-a9fe-d0bfbf589bdf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:02.578589 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2cca973f-6509-4291-a9fe-d0bfbf589bdf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:02.579323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-2cca973f-6509-4291-a9fe-d0bfbf589bdf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:02.583160 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3b49920d-a835-42f3-bcd9-ffccc96ad2d7 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.260861 Jul 07 15:40:02.588972 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 448/893] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:02 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:02.668670 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-2cca973f-6509-4291-a9fe-d0bfbf589bdf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lazy-loading 'services' on Instance uuid e54a14c0-4b58-4edc-9325-b1c7da38307d {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:40:02.888601 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e7ab0cb7-26de-4895-802b-504a1d9a7ccb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:02.889926 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e7ab0cb7-26de-4895-802b-504a1d9a7ccb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:02.897192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e7ab0cb7-26de-4895-802b-504a1d9a7ccb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:02.897645 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e7ab0cb7-26de-4895-802b-504a1d9a7ccb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:02.898415 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e7ab0cb7-26de-4895-802b-504a1d9a7ccb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:02.898849 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e7ab0cb7-26de-4895-802b-504a1d9a7ccb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:02.952600 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-2cca973f-6509-4291-a9fe-d0bfbf589bdf tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments/1e08231f-6327-4ff3-ace7-d717461c5783" status: 202 len: 0 microversion: 2.1 time: 0.391500 Jul 07 15:40:02.953297 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 446/894] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:40:02 2022] DELETE /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments/1e08231f-6327-4ff3-ace7-d717461c5783 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 15:40:02.965281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6c505488-bee8-4015-84b1-0021efb82c28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:02.966637 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6c505488-bee8-4015-84b1-0021efb82c28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:02.974537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6c505488-bee8-4015-84b1-0021efb82c28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:02.975036 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6c505488-bee8-4015-84b1-0021efb82c28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:02.978161 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6c505488-bee8-4015-84b1-0021efb82c28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:02.978161 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6c505488-bee8-4015-84b1-0021efb82c28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:03.008587 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6c505488-bee8-4015-84b1-0021efb82c28 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047873 Jul 07 15:40:03.009007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 447/895] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:02 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:40:03.059349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e7ab0cb7-26de-4895-802b-504a1d9a7ccb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:03.068600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e7ab0cb7-26de-4895-802b-504a1d9a7ccb tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.184692 Jul 07 15:40:03.069167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 449/896] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:02 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:03.602973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-036fbb33-ff4a-461e-9ac8-dc757daf3f63 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:03.603632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-036fbb33-ff4a-461e-9ac8-dc757daf3f63 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:03.610165 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-036fbb33-ff4a-461e-9ac8-dc757daf3f63 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:03.610875 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-036fbb33-ff4a-461e-9ac8-dc757daf3f63 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:03.611659 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-036fbb33-ff4a-461e-9ac8-dc757daf3f63 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:03.612089 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-036fbb33-ff4a-461e-9ac8-dc757daf3f63 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:03.817748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-036fbb33-ff4a-461e-9ac8-dc757daf3f63 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:03.825247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-036fbb33-ff4a-461e-9ac8-dc757daf3f63 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.226847 Jul 07 15:40:03.825864 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 448/897] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:03 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:04.019840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a4ffc184-29d6-4f00-b93a-f1515f4332f4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:04.021064 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a4ffc184-29d6-4f00-b93a-f1515f4332f4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:04.027586 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4ffc184-29d6-4f00-b93a-f1515f4332f4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:04.028064 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4ffc184-29d6-4f00-b93a-f1515f4332f4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:04.028830 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4ffc184-29d6-4f00-b93a-f1515f4332f4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:04.029266 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a4ffc184-29d6-4f00-b93a-f1515f4332f4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:04.057886 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a4ffc184-29d6-4f00-b93a-f1515f4332f4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042342 Jul 07 15:40:04.058433 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 450/898] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:04 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:04.085727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b86c5a15-c5cf-46f8-9341-afed9239cdd7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:04.086342 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b86c5a15-c5cf-46f8-9341-afed9239cdd7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:04.092571 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b86c5a15-c5cf-46f8-9341-afed9239cdd7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:04.093027 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b86c5a15-c5cf-46f8-9341-afed9239cdd7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:04.093788 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b86c5a15-c5cf-46f8-9341-afed9239cdd7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:04.094224 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b86c5a15-c5cf-46f8-9341-afed9239cdd7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:04.226605 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b86c5a15-c5cf-46f8-9341-afed9239cdd7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:04.234136 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b86c5a15-c5cf-46f8-9341-afed9239cdd7 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.152465 Jul 07 15:40:04.234700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 449/899] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:04 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:04.842093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-08926acc-1b9c-43ed-8e43-b57be79b1c3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:04.842728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-08926acc-1b9c-43ed-8e43-b57be79b1c3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:04.849408 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-08926acc-1b9c-43ed-8e43-b57be79b1c3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:04.849850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-08926acc-1b9c-43ed-8e43-b57be79b1c3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:04.850600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-08926acc-1b9c-43ed-8e43-b57be79b1c3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:04.851029 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-08926acc-1b9c-43ed-8e43-b57be79b1c3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:05.001958 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-08926acc-1b9c-43ed-8e43-b57be79b1c3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:05.009513 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-08926acc-1b9c-43ed-8e43-b57be79b1c3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.171193 Jul 07 15:40:05.010086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 451/900] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:04 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:05.069545 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1ee5468a-2480-47cb-9409-661eb35b925e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:05.070443 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1ee5468a-2480-47cb-9409-661eb35b925e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:05.072862 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=88 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:05.077676 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ee5468a-2480-47cb-9409-661eb35b925e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:05.078122 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ee5468a-2480-47cb-9409-661eb35b925e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:05.078879 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ee5468a-2480-47cb-9409-661eb35b925e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:05.079312 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1ee5468a-2480-47cb-9409-661eb35b925e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:05.109084 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1ee5468a-2480-47cb-9409-661eb35b925e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043626 Jul 07 15:40:05.109631 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 450/901] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:05 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:05.251667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-699cdcb3-066d-42ec-8e8a-a75fceb29942 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:05.252277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-699cdcb3-066d-42ec-8e8a-a75fceb29942 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:05.259342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-699cdcb3-066d-42ec-8e8a-a75fceb29942 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:05.259820 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-699cdcb3-066d-42ec-8e8a-a75fceb29942 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:05.260599 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-699cdcb3-066d-42ec-8e8a-a75fceb29942 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:05.261034 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-699cdcb3-066d-42ec-8e8a-a75fceb29942 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:05.466197 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-699cdcb3-066d-42ec-8e8a-a75fceb29942 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:05.474290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-699cdcb3-066d-42ec-8e8a-a75fceb29942 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.226429 Jul 07 15:40:05.474866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 452/902] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:05 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:06.027622 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d12e4b6b-3280-4684-a559-8f3c55f60944 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:06.028233 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d12e4b6b-3280-4684-a559-8f3c55f60944 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:06.034204 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d12e4b6b-3280-4684-a559-8f3c55f60944 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:06.034651 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d12e4b6b-3280-4684-a559-8f3c55f60944 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:06.035406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d12e4b6b-3280-4684-a559-8f3c55f60944 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:06.035868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d12e4b6b-3280-4684-a559-8f3c55f60944 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:06.120881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bfaf659e-6e33-4578-9c42-eb709a7ade09 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:06.121843 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bfaf659e-6e33-4578-9c42-eb709a7ade09 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:06.127939 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bfaf659e-6e33-4578-9c42-eb709a7ade09 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:06.128388 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bfaf659e-6e33-4578-9c42-eb709a7ade09 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:06.129647 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bfaf659e-6e33-4578-9c42-eb709a7ade09 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:06.130090 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bfaf659e-6e33-4578-9c42-eb709a7ade09 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:06.158922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bfaf659e-6e33-4578-9c42-eb709a7ade09 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041920 Jul 07 15:40:06.159493 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 453/903] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:06 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:40:06.167609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d12e4b6b-3280-4684-a559-8f3c55f60944 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:06.175043 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d12e4b6b-3280-4684-a559-8f3c55f60944 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.151690 Jul 07 15:40:06.175625 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 451/904] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:06 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:06.491435 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6719508a-0023-4139-b7c0-ec489c492735 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:06.492068 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6719508a-0023-4139-b7c0-ec489c492735 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:06.498525 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6719508a-0023-4139-b7c0-ec489c492735 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:06.498963 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6719508a-0023-4139-b7c0-ec489c492735 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:06.499757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6719508a-0023-4139-b7c0-ec489c492735 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:06.500188 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6719508a-0023-4139-b7c0-ec489c492735 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:06.635481 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6719508a-0023-4139-b7c0-ec489c492735 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:06.642898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6719508a-0023-4139-b7c0-ec489c492735 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.155926 Jul 07 15:40:06.643456 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 454/905] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:06 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:07.170336 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6b878266-f568-4119-b47a-bcb31a401a1e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:07.171235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6b878266-f568-4119-b47a-bcb31a401a1e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:07.177766 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6b878266-f568-4119-b47a-bcb31a401a1e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:07.178215 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6b878266-f568-4119-b47a-bcb31a401a1e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:07.178969 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6b878266-f568-4119-b47a-bcb31a401a1e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:07.179403 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6b878266-f568-4119-b47a-bcb31a401a1e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:07.191040 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7dabd9da-ca75-4b87-9c0d-877c3d1c2319 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:07.191705 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7dabd9da-ca75-4b87-9c0d-877c3d1c2319 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:07.197771 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7dabd9da-ca75-4b87-9c0d-877c3d1c2319 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:07.198216 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7dabd9da-ca75-4b87-9c0d-877c3d1c2319 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:07.198971 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7dabd9da-ca75-4b87-9c0d-877c3d1c2319 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:07.199400 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7dabd9da-ca75-4b87-9c0d-877c3d1c2319 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:07.208880 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6b878266-f568-4119-b47a-bcb31a401a1e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042448 Jul 07 15:40:07.209447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 452/906] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:07 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:07.271841 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:07.291527 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=6 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:07.328998 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7dabd9da-ca75-4b87-9c0d-877c3d1c2319 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:07.334814 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7dabd9da-ca75-4b87-9c0d-877c3d1c2319 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.147557 Jul 07 15:40:07.335373 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 455/907] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:07 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:07.659154 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cab44bf8-b668-45b5-84f3-60ddc4cd6972 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:07.659831 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cab44bf8-b668-45b5-84f3-60ddc4cd6972 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:07.666548 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cab44bf8-b668-45b5-84f3-60ddc4cd6972 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:07.667013 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cab44bf8-b668-45b5-84f3-60ddc4cd6972 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:07.667819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cab44bf8-b668-45b5-84f3-60ddc4cd6972 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:07.668282 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cab44bf8-b668-45b5-84f3-60ddc4cd6972 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:07.803444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cab44bf8-b668-45b5-84f3-60ddc4cd6972 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:07.811548 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cab44bf8-b668-45b5-84f3-60ddc4cd6972 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.156019 Jul 07 15:40:07.812158 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 453/908] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:07 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:08.220055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7759c158-e2b2-4db4-84fa-15a8d9086616 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:08.220991 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7759c158-e2b2-4db4-84fa-15a8d9086616 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:08.228516 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7759c158-e2b2-4db4-84fa-15a8d9086616 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:08.228968 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7759c158-e2b2-4db4-84fa-15a8d9086616 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:08.229728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7759c158-e2b2-4db4-84fa-15a8d9086616 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:08.230163 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7759c158-e2b2-4db4-84fa-15a8d9086616 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:08.259083 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7759c158-e2b2-4db4-84fa-15a8d9086616 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043044 Jul 07 15:40:08.259644 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 456/909] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:08 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:08.351544 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0fe447e0-fa5c-475b-acd0-ac82a8f86241 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:08.360848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0fe447e0-fa5c-475b-acd0-ac82a8f86241 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:08.360848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:08.360848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0fe447e0-fa5c-475b-acd0-ac82a8f86241 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:08.360848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0fe447e0-fa5c-475b-acd0-ac82a8f86241 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:08.361260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0fe447e0-fa5c-475b-acd0-ac82a8f86241 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:08.361260 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0fe447e0-fa5c-475b-acd0-ac82a8f86241 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:08.378494 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:08.490690 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0fe447e0-fa5c-475b-acd0-ac82a8f86241 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:08.498462 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0fe447e0-fa5c-475b-acd0-ac82a8f86241 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.150819 Jul 07 15:40:08.499015 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 454/910] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:08 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:08.828327 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b7d4f962-041f-4032-a516-fa338e819d04 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:08.828967 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b7d4f962-041f-4032-a516-fa338e819d04 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:08.834891 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b7d4f962-041f-4032-a516-fa338e819d04 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:08.835353 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b7d4f962-041f-4032-a516-fa338e819d04 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:08.836184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b7d4f962-041f-4032-a516-fa338e819d04 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:08.836623 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b7d4f962-041f-4032-a516-fa338e819d04 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:08.966997 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b7d4f962-041f-4032-a516-fa338e819d04 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:08.975250 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b7d4f962-041f-4032-a516-fa338e819d04 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.150867 Jul 07 15:40:08.975840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 457/911] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:08 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:09.270974 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-62a4069f-4f73-4cc0-84e0-f5d5c6f5bf3f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:09.271906 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-62a4069f-4f73-4cc0-84e0-f5d5c6f5bf3f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:09.277932 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-62a4069f-4f73-4cc0-84e0-f5d5c6f5bf3f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:09.278375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-62a4069f-4f73-4cc0-84e0-f5d5c6f5bf3f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:09.279124 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-62a4069f-4f73-4cc0-84e0-f5d5c6f5bf3f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:09.279549 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-62a4069f-4f73-4cc0-84e0-f5d5c6f5bf3f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:09.308323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-62a4069f-4f73-4cc0-84e0-f5d5c6f5bf3f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041932 Jul 07 15:40:09.308856 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 455/912] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:09 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:09.516115 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8ff2b875-3c13-4b22-b022-cb10553d7356 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:09.516717 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8ff2b875-3c13-4b22-b022-cb10553d7356 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:09.523638 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ff2b875-3c13-4b22-b022-cb10553d7356 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:09.524030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ff2b875-3c13-4b22-b022-cb10553d7356 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:09.524779 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ff2b875-3c13-4b22-b022-cb10553d7356 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:09.525204 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8ff2b875-3c13-4b22-b022-cb10553d7356 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:09.658700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8ff2b875-3c13-4b22-b022-cb10553d7356 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:09.666291 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8ff2b875-3c13-4b22-b022-cb10553d7356 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.154028 Jul 07 15:40:09.666935 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 458/913] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:09 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:09.992710 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-68175c52-3560-492d-9fb6-2ea114bfe978 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:09.993322 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-68175c52-3560-492d-9fb6-2ea114bfe978 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:09.999809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-68175c52-3560-492d-9fb6-2ea114bfe978 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:10.000261 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-68175c52-3560-492d-9fb6-2ea114bfe978 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:10.001027 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-68175c52-3560-492d-9fb6-2ea114bfe978 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:10.001462 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-68175c52-3560-492d-9fb6-2ea114bfe978 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:10.132803 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-68175c52-3560-492d-9fb6-2ea114bfe978 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:10.140409 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-68175c52-3560-492d-9fb6-2ea114bfe978 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.152122 Jul 07 15:40:10.140967 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 456/914] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:09 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:10.320460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-57824f52-fa2f-4e18-98b3-77985771babe tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:10.321426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-57824f52-fa2f-4e18-98b3-77985771babe tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:10.327419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57824f52-fa2f-4e18-98b3-77985771babe tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:10.327893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57824f52-fa2f-4e18-98b3-77985771babe tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:10.328649 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57824f52-fa2f-4e18-98b3-77985771babe tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:10.329079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-57824f52-fa2f-4e18-98b3-77985771babe tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:10.368120 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-57824f52-fa2f-4e18-98b3-77985771babe tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052178 Jul 07 15:40:10.368685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 459/915] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:10 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:10.683256 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6917268c-3ac3-4d27-a16e-325f397fae2d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:10.683972 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6917268c-3ac3-4d27-a16e-325f397fae2d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:10.689912 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6917268c-3ac3-4d27-a16e-325f397fae2d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:10.690353 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6917268c-3ac3-4d27-a16e-325f397fae2d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:10.691098 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6917268c-3ac3-4d27-a16e-325f397fae2d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:10.691531 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6917268c-3ac3-4d27-a16e-325f397fae2d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:10.831530 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6917268c-3ac3-4d27-a16e-325f397fae2d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:10.845553 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6917268c-3ac3-4d27-a16e-325f397fae2d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.166046 Jul 07 15:40:10.846255 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 457/916] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:10 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:10.890152 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-05622ec4-f591-4963-a91a-5a9e4486228c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:10.891084 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-05622ec4-f591-4963-a91a-5a9e4486228c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:10.899266 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05622ec4-f591-4963-a91a-5a9e4486228c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:10.899896 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05622ec4-f591-4963-a91a-5a9e4486228c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:10.900677 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05622ec4-f591-4963-a91a-5a9e4486228c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:10.901120 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05622ec4-f591-4963-a91a-5a9e4486228c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:10.923477 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:10.938019 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-05622ec4-f591-4963-a91a-5a9e4486228c tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054875 Jul 07 15:40:10.938501 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 460/917] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:10 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:11.043032 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4da73d31-a457-4999-a6dd-583cbe2d9ab3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:11.043610 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4da73d31-a457-4999-a6dd-583cbe2d9ab3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:11.050021 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4da73d31-a457-4999-a6dd-583cbe2d9ab3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.050567 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4da73d31-a457-4999-a6dd-583cbe2d9ab3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:11.051868 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4da73d31-a457-4999-a6dd-583cbe2d9ab3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.052302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4da73d31-a457-4999-a6dd-583cbe2d9ab3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:11.083964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4da73d31-a457-4999-a6dd-583cbe2d9ab3 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/59390504-35ba-4d92-b305-24fc821caf36" status: 200 len: 194 microversion: 2.1 time: 0.044857 Jul 07 15:40:11.084658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 458/918] 10.222.0.25 () {58 vars in 1412 bytes} [Thu Jul 7 15:40:11 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/59390504-35ba-4d92-b305-24fc821caf36 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:11.095029 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-03e9b086-063e-4f16-930f-617df1da8980 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:11.095646 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-03e9b086-063e-4f16-930f-617df1da8980 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:11.101875 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03e9b086-063e-4f16-930f-617df1da8980 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.106053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03e9b086-063e-4f16-930f-617df1da8980 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:11.106053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03e9b086-063e-4f16-930f-617df1da8980 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.106053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03e9b086-063e-4f16-930f-617df1da8980 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:11.158646 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-84595944-cff9-471b-a96d-56d86fd28de2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:11.159251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-84595944-cff9-471b-a96d-56d86fd28de2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:11.166235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-84595944-cff9-471b-a96d-56d86fd28de2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.166678 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-84595944-cff9-471b-a96d-56d86fd28de2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:11.167464 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-84595944-cff9-471b-a96d-56d86fd28de2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.168002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-84595944-cff9-471b-a96d-56d86fd28de2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:11.185962 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-03e9b086-063e-4f16-930f-617df1da8980 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lazy-loading 'services' on Instance uuid b1243dbb-87ee-43ac-8729-d18c53114d43 {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:40:11.304323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-84595944-cff9-471b-a96d-56d86fd28de2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:11.312909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-84595944-cff9-471b-a96d-56d86fd28de2 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.159031 Jul 07 15:40:11.313426 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 459/919] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:11 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:11.379846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-21b08e82-e546-4a52-9aa2-495ad44714b1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:11.380784 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-21b08e82-e546-4a52-9aa2-495ad44714b1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:11.386827 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-21b08e82-e546-4a52-9aa2-495ad44714b1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.387271 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-21b08e82-e546-4a52-9aa2-495ad44714b1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:11.388051 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-21b08e82-e546-4a52-9aa2-495ad44714b1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.388479 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-21b08e82-e546-4a52-9aa2-495ad44714b1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:11.399821 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-03e9b086-063e-4f16-930f-617df1da8980 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/59390504-35ba-4d92-b305-24fc821caf36" status: 202 len: 0 microversion: 2.1 time: 0.308861 Jul 07 15:40:11.400478 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 461/920] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:40:11 2022] DELETE /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/59390504-35ba-4d92-b305-24fc821caf36 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:40:11.421669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-21b08e82-e546-4a52-9aa2-495ad44714b1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046097 Jul 07 15:40:11.425631 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 460/921] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:11 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:40:11.862964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-393f21c9-454d-4732-979e-cf02d070da62 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:11.864314 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-393f21c9-454d-4732-979e-cf02d070da62 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:11.870828 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-393f21c9-454d-4732-979e-cf02d070da62 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.871272 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-393f21c9-454d-4732-979e-cf02d070da62 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:11.878825 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-393f21c9-454d-4732-979e-cf02d070da62 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:11.878825 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-393f21c9-454d-4732-979e-cf02d070da62 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:12.006010 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-393f21c9-454d-4732-979e-cf02d070da62 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:12.013430 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-393f21c9-454d-4732-979e-cf02d070da62 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1276 microversion: 2.1 time: 0.154993 Jul 07 15:40:12.013994 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 462/922] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:11 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:12.330668 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8d5cf979-5c3a-498a-852e-da6565a7a02d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:12.331272 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8d5cf979-5c3a-498a-852e-da6565a7a02d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:12.338760 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8d5cf979-5c3a-498a-852e-da6565a7a02d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:12.339204 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8d5cf979-5c3a-498a-852e-da6565a7a02d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:12.339995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8d5cf979-5c3a-498a-852e-da6565a7a02d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:12.340424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8d5cf979-5c3a-498a-852e-da6565a7a02d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:12.432511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-03f42bfb-cffe-4a3d-a0c6-667d05da4bb1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:12.433481 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-03f42bfb-cffe-4a3d-a0c6-667d05da4bb1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:12.435466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:12.440312 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03f42bfb-cffe-4a3d-a0c6-667d05da4bb1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:12.440765 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03f42bfb-cffe-4a3d-a0c6-667d05da4bb1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:12.441565 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03f42bfb-cffe-4a3d-a0c6-667d05da4bb1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:12.441997 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-03f42bfb-cffe-4a3d-a0c6-667d05da4bb1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:12.481124 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-03f42bfb-cffe-4a3d-a0c6-667d05da4bb1 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052431 Jul 07 15:40:12.482804 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 463/923] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:12 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:40:12.493560 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8d5cf979-5c3a-498a-852e-da6565a7a02d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:12.514557 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8d5cf979-5c3a-498a-852e-da6565a7a02d tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.187738 Jul 07 15:40:12.515775 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 461/924] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:12 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:13.030997 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3325773e-7318-4f80-be36-603e993cc2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:13.032106 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3325773e-7318-4f80-be36-603e993cc2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:13.039150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3325773e-7318-4f80-be36-603e993cc2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:13.043844 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3325773e-7318-4f80-be36-603e993cc2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:13.043844 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3325773e-7318-4f80-be36-603e993cc2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:13.043844 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3325773e-7318-4f80-be36-603e993cc2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:13.206227 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3325773e-7318-4f80-be36-603e993cc2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:13.213605 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3325773e-7318-4f80-be36-603e993cc2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.187263 Jul 07 15:40:13.214220 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 464/925] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:13 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:13.493279 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6541c161-1713-44ab-baf7-bbb126529771 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:13.494234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6541c161-1713-44ab-baf7-bbb126529771 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:13.500677 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6541c161-1713-44ab-baf7-bbb126529771 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:13.501118 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6541c161-1713-44ab-baf7-bbb126529771 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:13.501876 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6541c161-1713-44ab-baf7-bbb126529771 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:13.502307 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6541c161-1713-44ab-baf7-bbb126529771 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:13.533210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6541c161-1713-44ab-baf7-bbb126529771 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044449 Jul 07 15:40:13.533770 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 462/926] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:13 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:40:13.536902 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e251b00a-6dcd-4580-b13f-78cce6abf6c1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:13.537909 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e251b00a-6dcd-4580-b13f-78cce6abf6c1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:13.549002 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e251b00a-6dcd-4580-b13f-78cce6abf6c1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:13.549732 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e251b00a-6dcd-4580-b13f-78cce6abf6c1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:13.551969 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e251b00a-6dcd-4580-b13f-78cce6abf6c1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:13.553194 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e251b00a-6dcd-4580-b13f-78cce6abf6c1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:13.652207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-61303d71-3648-4f15-aff4-d9e2aa2f12a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:13.653061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-61303d71-3648-4f15-aff4-d9e2aa2f12a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:13.660119 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-61303d71-3648-4f15-aff4-d9e2aa2f12a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:13.661797 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-61303d71-3648-4f15-aff4-d9e2aa2f12a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:13.662732 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-61303d71-3648-4f15-aff4-d9e2aa2f12a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:13.663409 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-61303d71-3648-4f15-aff4-d9e2aa2f12a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:13.706692 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-61303d71-3648-4f15-aff4-d9e2aa2f12a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Going to try to terminate instance {{(pid=124720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:40:13.733514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e251b00a-6dcd-4580-b13f-78cce6abf6c1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:13.741452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e251b00a-6dcd-4580-b13f-78cce6abf6c1 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.212329 Jul 07 15:40:13.742354 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 465/927] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:13 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:14.033584 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-61303d71-3648-4f15-aff4-d9e2aa2f12a4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 204 len: 0 microversion: 2.1 time: 0.385286 Jul 07 15:40:14.034367 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 463/928] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:40:13 2022] DELETE /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:40:14.042735 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ffda6b3b-d671-42da-b03c-bdfc4306762f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:14.043456 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ffda6b3b-d671-42da-b03c-bdfc4306762f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:14.049888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ffda6b3b-d671-42da-b03c-bdfc4306762f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.050326 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ffda6b3b-d671-42da-b03c-bdfc4306762f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.051605 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ffda6b3b-d671-42da-b03c-bdfc4306762f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.052037 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ffda6b3b-d671-42da-b03c-bdfc4306762f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.182112 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ffda6b3b-d671-42da-b03c-bdfc4306762f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:14.189660 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ffda6b3b-d671-42da-b03c-bdfc4306762f tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1681 microversion: 2.1 time: 0.150925 Jul 07 15:40:14.190372 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 466/929] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:14 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:14.232838 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-c9de7f0a-3724-4b99-9d2c-63c59ea4f6a5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:14.233463 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-c9de7f0a-3724-4b99-9d2c-63c59ea4f6a5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:14.241118 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c9de7f0a-3724-4b99-9d2c-63c59ea4f6a5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.241536 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c9de7f0a-3724-4b99-9d2c-63c59ea4f6a5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.242372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c9de7f0a-3724-4b99-9d2c-63c59ea4f6a5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.242848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-c9de7f0a-3724-4b99-9d2c-63c59ea4f6a5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.347616 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-bb8a2ee8-0d18-4a98-a049-64eb4a332ac6 req-e142ae98-531c-4c5f-a06b-a22e5802e0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8af2eb-fd79-4b8d-a9ef-648a1959ded8", "name": "network-vif-plugged", "status": "completed", "tag": "bcf3a191-4ef0-4048-9b74-408448e7ee6d"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:40:14.356694 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-bb8a2ee8-0d18-4a98-a049-64eb4a332ac6 req-e142ae98-531c-4c5f-a06b-a22e5802e0c8 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.357157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-bb8a2ee8-0d18-4a98-a049-64eb4a332ac6 req-e142ae98-531c-4c5f-a06b-a22e5802e0c8 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.368939 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-bb8a2ee8-0d18-4a98-a049-64eb4a332ac6 req-e142ae98-531c-4c5f-a06b-a22e5802e0c8 service nova] Creating event network-vif-plugged:bcf3a191-4ef0-4048-9b74-408448e7ee6d for instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 on hv-cinder-84130 Jul 07 15:40:14.373766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-bb8a2ee8-0d18-4a98-a049-64eb4a332ac6 req-e142ae98-531c-4c5f-a06b-a22e5802e0c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030606 Jul 07 15:40:14.374336 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 467/930] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:14.387686 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-c9de7f0a-3724-4b99-9d2c-63c59ea4f6a5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:14.395182 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-c9de7f0a-3724-4b99-9d2c-63c59ea4f6a5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.167736 Jul 07 15:40:14.395771 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 464/931] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:14 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:14.670425 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9cf2a121-59c4-48d9-a184-6ba6155c75f0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:14.670999 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9cf2a121-59c4-48d9-a184-6ba6155c75f0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:14.677290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9cf2a121-59c4-48d9-a184-6ba6155c75f0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.677772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9cf2a121-59c4-48d9-a184-6ba6155c75f0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.678525 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9cf2a121-59c4-48d9-a184-6ba6155c75f0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.679026 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9cf2a121-59c4-48d9-a184-6ba6155c75f0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.707893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9cf2a121-59c4-48d9-a184-6ba6155c75f0 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/ca444736-cd3e-46e8-a68c-995f1d2d7cc7" status: 200 len: 194 microversion: 2.1 time: 0.041251 Jul 07 15:40:14.708447 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 468/932] 10.222.0.25 () {58 vars in 1412 bytes} [Thu Jul 7 15:40:14 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/ca444736-cd3e-46e8-a68c-995f1d2d7cc7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:14.717982 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5a73f8b6-6c8d-438c-8bfa-993b40832206 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:14.718500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5a73f8b6-6c8d-438c-8bfa-993b40832206 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:14.725524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5a73f8b6-6c8d-438c-8bfa-993b40832206 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.725998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5a73f8b6-6c8d-438c-8bfa-993b40832206 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.726750 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5a73f8b6-6c8d-438c-8bfa-993b40832206 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.727183 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5a73f8b6-6c8d-438c-8bfa-993b40832206 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.759442 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1aca08c7-b70d-4e2f-9c8d-4ea8a591158b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:14.760107 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1aca08c7-b70d-4e2f-9c8d-4ea8a591158b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:14.766301 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1aca08c7-b70d-4e2f-9c8d-4ea8a591158b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.766744 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1aca08c7-b70d-4e2f-9c8d-4ea8a591158b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.767494 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1aca08c7-b70d-4e2f-9c8d-4ea8a591158b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:14.767942 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1aca08c7-b70d-4e2f-9c8d-4ea8a591158b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:14.806670 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-5a73f8b6-6c8d-438c-8bfa-993b40832206 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lazy-loading 'services' on Instance uuid b1243dbb-87ee-43ac-8729-d18c53114d43 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:40:14.900006 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1aca08c7-b70d-4e2f-9c8d-4ea8a591158b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:14.907451 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1aca08c7-b70d-4e2f-9c8d-4ea8a591158b tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.151812 Jul 07 15:40:14.908038 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 469/933] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:14 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:15.005447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5a73f8b6-6c8d-438c-8bfa-993b40832206 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/ca444736-cd3e-46e8-a68c-995f1d2d7cc7" status: 202 len: 0 microversion: 2.1 time: 0.291176 Jul 07 15:40:15.006060 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 465/934] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:40:14 2022] DELETE /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments/ca444736-cd3e-46e8-a68c-995f1d2d7cc7 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 15:40:15.206117 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c653b144-7998-4724-982e-f3bcc0205f1b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:15.206713 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c653b144-7998-4724-982e-f3bcc0205f1b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:15.213675 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c653b144-7998-4724-982e-f3bcc0205f1b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:15.214114 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c653b144-7998-4724-982e-f3bcc0205f1b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:15.214866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c653b144-7998-4724-982e-f3bcc0205f1b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:15.215290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c653b144-7998-4724-982e-f3bcc0205f1b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:15.353573 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c653b144-7998-4724-982e-f3bcc0205f1b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:15.361274 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c653b144-7998-4724-982e-f3bcc0205f1b tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1681 microversion: 2.1 time: 0.159000 Jul 07 15:40:15.363699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 470/935] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:15 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:15.413148 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-79cb4f74-5747-4197-9bcd-9c0bf2ec2edc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:15.413850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-79cb4f74-5747-4197-9bcd-9c0bf2ec2edc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:15.420232 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-79cb4f74-5747-4197-9bcd-9c0bf2ec2edc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:15.420680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-79cb4f74-5747-4197-9bcd-9c0bf2ec2edc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:15.421442 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-79cb4f74-5747-4197-9bcd-9c0bf2ec2edc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:15.421877 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-79cb4f74-5747-4197-9bcd-9c0bf2ec2edc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:15.561184 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-79cb4f74-5747-4197-9bcd-9c0bf2ec2edc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:15.569037 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-79cb4f74-5747-4197-9bcd-9c0bf2ec2edc tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.160748 Jul 07 15:40:15.569605 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 466/936] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:15 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:15.924639 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0270eeb9-e1d5-4ef5-8302-2884f53c8b51 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:15.925241 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0270eeb9-e1d5-4ef5-8302-2884f53c8b51 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:15.931583 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0270eeb9-e1d5-4ef5-8302-2884f53c8b51 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:15.932488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0270eeb9-e1d5-4ef5-8302-2884f53c8b51 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:15.932813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0270eeb9-e1d5-4ef5-8302-2884f53c8b51 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:15.933249 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0270eeb9-e1d5-4ef5-8302-2884f53c8b51 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:16.113904 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0270eeb9-e1d5-4ef5-8302-2884f53c8b51 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:16.126707 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0270eeb9-e1d5-4ef5-8302-2884f53c8b51 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.205842 Jul 07 15:40:16.130652 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 471/937] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:15 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:16.378629 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-81043157-801c-4a52-ab73-7af9b699c989 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:16.379835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-81043157-801c-4a52-ab73-7af9b699c989 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:16.386471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-81043157-801c-4a52-ab73-7af9b699c989 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:16.386922 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-81043157-801c-4a52-ab73-7af9b699c989 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:16.387718 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-81043157-801c-4a52-ab73-7af9b699c989 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:16.388144 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-81043157-801c-4a52-ab73-7af9b699c989 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:16.539913 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-81043157-801c-4a52-ab73-7af9b699c989 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:16.547899 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-81043157-801c-4a52-ab73-7af9b699c989 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1681 microversion: 2.1 time: 0.173359 Jul 07 15:40:16.548725 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 467/938] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:16 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:16.586118 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f5005404-d0cf-424f-9863-523a646e1de2 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:16.586706 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f5005404-d0cf-424f-9863-523a646e1de2 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:16.594002 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5005404-d0cf-424f-9863-523a646e1de2 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:16.594530 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5005404-d0cf-424f-9863-523a646e1de2 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:16.595369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5005404-d0cf-424f-9863-523a646e1de2 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:16.595887 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f5005404-d0cf-424f-9863-523a646e1de2 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:16.730580 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f5005404-d0cf-424f-9863-523a646e1de2 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:16.738956 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f5005404-d0cf-424f-9863-523a646e1de2 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.157315 Jul 07 15:40:16.739751 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 472/939] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:16 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:17.145675 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6e999679-2390-4405-9528-fb8ba5b26990 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:17.146392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6e999679-2390-4405-9528-fb8ba5b26990 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:17.152591 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6e999679-2390-4405-9528-fb8ba5b26990 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.153034 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6e999679-2390-4405-9528-fb8ba5b26990 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.153786 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6e999679-2390-4405-9528-fb8ba5b26990 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.154210 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6e999679-2390-4405-9528-fb8ba5b26990 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.243703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6a8cbe71-f365-4a97-97c8-e4ee14d949fd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:17.244684 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6a8cbe71-f365-4a97-97c8-e4ee14d949fd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:17.250756 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6a8cbe71-f365-4a97-97c8-e4ee14d949fd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.251210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6a8cbe71-f365-4a97-97c8-e4ee14d949fd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.252108 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6a8cbe71-f365-4a97-97c8-e4ee14d949fd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.252546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6a8cbe71-f365-4a97-97c8-e4ee14d949fd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.282600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6a8cbe71-f365-4a97-97c8-e4ee14d949fd tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042780 Jul 07 15:40:17.284183 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 473/940] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:17 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 07 15:40:17.305073 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6e999679-2390-4405-9528-fb8ba5b26990 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:17.308676 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:17.312940 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6e999679-2390-4405-9528-fb8ba5b26990 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1575 microversion: 2.1 time: 0.171289 Jul 07 15:40:17.313743 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 468/941] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:17 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:17.412217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-05776a9e-be99-41c8-a176-28cdf7f9ac9a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:17.413161 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-05776a9e-be99-41c8-a176-28cdf7f9ac9a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:17.419234 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05776a9e-be99-41c8-a176-28cdf7f9ac9a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.419724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05776a9e-be99-41c8-a176-28cdf7f9ac9a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.420522 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05776a9e-be99-41c8-a176-28cdf7f9ac9a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.420955 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-05776a9e-be99-41c8-a176-28cdf7f9ac9a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.451906 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-05776a9e-be99-41c8-a176-28cdf7f9ac9a tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044249 Jul 07 15:40:17.452481 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 474/942] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:40:17 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:40:17.491679 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-95422cf0-7f01-497e-a9e4-46af4764676f req-3f9df450-aa49-4b8b-b16a-d808e05311d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54a14c0-4b58-4edc-9325-b1c7da38307d", "name": "network-vif-deleted", "tag": "8bf95f95-95f0-423b-b959-585f3cb8cc66"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:40:17.503805 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-95422cf0-7f01-497e-a9e4-46af4764676f req-3f9df450-aa49-4b8b-b16a-d808e05311d1 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.504853 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-95422cf0-7f01-497e-a9e4-46af4764676f req-3f9df450-aa49-4b8b-b16a-d808e05311d1 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.513795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-eeaef906-beea-473c-a601-d4286914411f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:17.514289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-eeaef906-beea-473c-a601-d4286914411f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:17.517763 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-95422cf0-7f01-497e-a9e4-46af4764676f req-3f9df450-aa49-4b8b-b16a-d808e05311d1 service nova] Creating event network-vif-deleted:8bf95f95-95f0-423b-b959-585f3cb8cc66 for instance e54a14c0-4b58-4edc-9325-b1c7da38307d on hv-cinder-84130 Jul 07 15:40:17.520850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eeaef906-beea-473c-a601-d4286914411f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.521308 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eeaef906-beea-473c-a601-d4286914411f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.522076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eeaef906-beea-473c-a601-d4286914411f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.522509 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eeaef906-beea-473c-a601-d4286914411f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.523658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-95422cf0-7f01-497e-a9e4-46af4764676f req-3f9df450-aa49-4b8b-b16a-d808e05311d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036978 Jul 07 15:40:17.524330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 469/943] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:17.553734 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-eeaef906-beea-473c-a601-d4286914411f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:40:17.567301 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-206df75b-a024-4d7a-9c01-4e664b1c3c78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:17.568513 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-206df75b-a024-4d7a-9c01-4e664b1c3c78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:17.577303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-206df75b-a024-4d7a-9c01-4e664b1c3c78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.577899 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-206df75b-a024-4d7a-9c01-4e664b1c3c78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.578683 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-206df75b-a024-4d7a-9c01-4e664b1c3c78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.579111 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-206df75b-a024-4d7a-9c01-4e664b1c3c78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.656869 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-206df75b-a024-4d7a-9c01-4e664b1c3c78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:17.665542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-206df75b-a024-4d7a-9c01-4e664b1c3c78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1614 microversion: 2.1 time: 0.103876 Jul 07 15:40:17.666121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 470/944] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:17 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:17.692625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:17.756817 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-126eb390-b32c-4f80-a971-69db4e740133 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:17.757431 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-126eb390-b32c-4f80-a971-69db4e740133 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:17.764803 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-126eb390-b32c-4f80-a971-69db4e740133 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.765272 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-126eb390-b32c-4f80-a971-69db4e740133 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.766024 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-126eb390-b32c-4f80-a971-69db4e740133 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.766456 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-126eb390-b32c-4f80-a971-69db4e740133 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.914628 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-eeaef906-beea-473c-a601-d4286914411f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 204 len: 0 microversion: 2.1 time: 0.404275 Jul 07 15:40:17.915649 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 475/945] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:40:17 2022] DELETE /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:40:17.921554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-126eb390-b32c-4f80-a971-69db4e740133 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:17.925054 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6dc6d1aa-b233-4407-83bf-e4d09766c846 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:17.929112 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6dc6d1aa-b233-4407-83bf-e4d09766c846 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:17.930121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-126eb390-b32c-4f80-a971-69db4e740133 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.177552 Jul 07 15:40:17.931481 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 471/946] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:17 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:17.935714 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6dc6d1aa-b233-4407-83bf-e4d09766c846 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.936231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6dc6d1aa-b233-4407-83bf-e4d09766c846 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:17.937093 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6dc6d1aa-b233-4407-83bf-e4d09766c846 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:17.937593 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6dc6d1aa-b233-4407-83bf-e4d09766c846 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:18.077467 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6dc6d1aa-b233-4407-83bf-e4d09766c846 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:18.085942 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6dc6d1aa-b233-4407-83bf-e4d09766c846 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1671 microversion: 2.1 time: 0.165536 Jul 07 15:40:18.086582 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 476/947] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:17 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:18.331467 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-199c719a-cf32-44e0-b449-dde5ca0cb955 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:18.332522 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-199c719a-cf32-44e0-b449-dde5ca0cb955 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:18.339004 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-199c719a-cf32-44e0-b449-dde5ca0cb955 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:18.339455 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-199c719a-cf32-44e0-b449-dde5ca0cb955 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:18.340258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-199c719a-cf32-44e0-b449-dde5ca0cb955 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:18.340689 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-199c719a-cf32-44e0-b449-dde5ca0cb955 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:18.485380 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-199c719a-cf32-44e0-b449-dde5ca0cb955 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:18.494750 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-199c719a-cf32-44e0-b449-dde5ca0cb955 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1562 microversion: 2.1 time: 0.168172 Jul 07 15:40:18.505506 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 472/948] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:18 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:18.683121 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:18.683759 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:18.690317 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:18.690784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:18.691522 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:18.691977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:18.721374 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:18.721980 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:18.722242 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lazy-loading 'fault' on Instance uuid e54a14c0-4b58-4edc-9325-b1c7da38307d {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:40:18.763678 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:18.771251 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5029c42e-81eb-470b-88d7-a3cd725d8794 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1332 microversion: 2.1 time: 0.091990 Jul 07 15:40:18.775386 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 477/949] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:18 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:18.946107 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3f5615d9-65c9-4c35-8ba8-ad4fe2f98e3d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:18.946710 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3f5615d9-65c9-4c35-8ba8-ad4fe2f98e3d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:18.953174 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3f5615d9-65c9-4c35-8ba8-ad4fe2f98e3d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:18.953617 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3f5615d9-65c9-4c35-8ba8-ad4fe2f98e3d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:18.954374 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3f5615d9-65c9-4c35-8ba8-ad4fe2f98e3d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:18.954800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3f5615d9-65c9-4c35-8ba8-ad4fe2f98e3d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:19.088318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3f5615d9-65c9-4c35-8ba8-ad4fe2f98e3d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:19.095672 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3f5615d9-65c9-4c35-8ba8-ad4fe2f98e3d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.153358 Jul 07 15:40:19.096234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 473/950] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:18 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:19.102904 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-dd1942a4-874e-4a1d-ab63-22608dc5aa02 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:19.103526 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-dd1942a4-874e-4a1d-ab63-22608dc5aa02 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:19.109582 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dd1942a4-874e-4a1d-ab63-22608dc5aa02 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:19.110022 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dd1942a4-874e-4a1d-ab63-22608dc5aa02 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:19.111036 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dd1942a4-874e-4a1d-ab63-22608dc5aa02 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:19.111463 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dd1942a4-874e-4a1d-ab63-22608dc5aa02 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:19.241479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-dd1942a4-874e-4a1d-ab63-22608dc5aa02 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:19.248991 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-dd1942a4-874e-4a1d-ab63-22608dc5aa02 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1671 microversion: 2.1 time: 0.149983 Jul 07 15:40:19.253323 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 478/951] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:19 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:19.788640 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:19.789263 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:19.795319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:19.795816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:19.796570 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:19.797004 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:19.827050 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:19.827493 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:19.827964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lazy-loading 'fault' on Instance uuid e54a14c0-4b58-4edc-9325-b1c7da38307d {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:40:19.867595 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e09539caff4d4698cf29c1ea22d365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b37250ea6d4c4eb242c27ce9819dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:19.875036 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e584ba44-66c5-4e7d-a361-745452bb667e tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 200 len: 1332 microversion: 2.1 time: 0.090281 Jul 07 15:40:19.875632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 474/952] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:19 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:20.116556 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-93e248d0-ce08-47f0-903c-72945f189640 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:20.117174 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-93e248d0-ce08-47f0-903c-72945f189640 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:20.123705 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-93e248d0-ce08-47f0-903c-72945f189640 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:20.124157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-93e248d0-ce08-47f0-903c-72945f189640 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:20.124916 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-93e248d0-ce08-47f0-903c-72945f189640 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:20.125349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-93e248d0-ce08-47f0-903c-72945f189640 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:20.260617 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-93e248d0-ce08-47f0-903c-72945f189640 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:20.266401 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-bd5fa614-50ac-4fa9-8173-74ff82fa40ab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:20.266975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-bd5fa614-50ac-4fa9-8173-74ff82fa40ab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:20.268555 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-93e248d0-ce08-47f0-903c-72945f189640 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.156290 Jul 07 15:40:20.269189 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 479/953] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:20 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:20.273917 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd5fa614-50ac-4fa9-8173-74ff82fa40ab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:20.274552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd5fa614-50ac-4fa9-8173-74ff82fa40ab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:20.275135 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd5fa614-50ac-4fa9-8173-74ff82fa40ab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:20.275584 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bd5fa614-50ac-4fa9-8173-74ff82fa40ab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:20.413783 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-bd5fa614-50ac-4fa9-8173-74ff82fa40ab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:20.421511 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-bd5fa614-50ac-4fa9-8173-74ff82fa40ab tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1671 microversion: 2.1 time: 0.158947 Jul 07 15:40:20.422102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 475/954] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:20 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:20.892383 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:20.893301 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:20.899429 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:20.899908 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:20.900669 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:20.901129 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:20.919427 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d HTTP/1.1 Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:20.921184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:20.922729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'e54a14c0-4b58-4edc-9325-b1c7da38307d'} Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:20.923785 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:20.925262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:20.927855 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:20.927855 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-df45dda8-2a86-4de2-a258-bab8092979df tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 404 len: 111 microversion: 2.1 time: 0.034067 Jul 07 15:40:20.927855 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 480/955] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:20 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:20.933890 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f0734c58-9a76-4c4d-975d-ce4903bfff08 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '.version_select at 0x7f5248daff70>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:21.017137 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f0734c58-9a76-4c4d-975d-ce4903bfff08 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804621041" status: 202 len: 0 microversion: 2.1 time: 0.088136 Jul 07 15:40:21.018269 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 476/956] 10.222.0.25 () {58 vars in 1220 bytes} [Thu Jul 7 15:40:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804621041 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:40:21.284856 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e1ea6442-9d9e-40e0-af8d-f4abde8e366c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:21.286210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e1ea6442-9d9e-40e0-af8d-f4abde8e366c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:21.292805 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e1ea6442-9d9e-40e0-af8d-f4abde8e366c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:21.293251 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e1ea6442-9d9e-40e0-af8d-f4abde8e366c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:21.294007 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e1ea6442-9d9e-40e0-af8d-f4abde8e366c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:21.294436 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e1ea6442-9d9e-40e0-af8d-f4abde8e366c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:21.428462 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e1ea6442-9d9e-40e0-af8d-f4abde8e366c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:21.436841 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e1ea6442-9d9e-40e0-af8d-f4abde8e366c tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.155881 Jul 07 15:40:21.437627 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 481/957] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:21 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:21.450095 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-af51de28-ce80-431b-9978-67234c8f0fa9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:21.450095 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-af51de28-ce80-431b-9978-67234c8f0fa9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:21.450095 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af51de28-ce80-431b-9978-67234c8f0fa9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:21.450095 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af51de28-ce80-431b-9978-67234c8f0fa9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:21.450597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af51de28-ce80-431b-9978-67234c8f0fa9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:21.450597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-af51de28-ce80-431b-9978-67234c8f0fa9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:21.517999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-af51de28-ce80-431b-9978-67234c8f0fa9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dec80a83aa463b99bd298ab09dfbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a98614df914018b7ecfb68afb735c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:21.526968 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-af51de28-ce80-431b-9978-67234c8f0fa9 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 200 len: 1603 microversion: 2.1 time: 0.092507 Jul 07 15:40:21.528282 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 477/958] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:21 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 1603 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:40:21.603547 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-dbc5608f-bb63-4f19-9bea-86c7de7743e5 req-aacad7d6-f09a-4fa1-83b5-a2ccb1a245b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1243dbb-87ee-43ac-8729-d18c53114d43", "name": "network-vif-deleted", "tag": "2482ebe6-1259-4f2f-83d7-763ce7639812"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:40:21.623421 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-dbc5608f-bb63-4f19-9bea-86c7de7743e5 req-aacad7d6-f09a-4fa1-83b5-a2ccb1a245b1 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:21.628370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-dbc5608f-bb63-4f19-9bea-86c7de7743e5 req-aacad7d6-f09a-4fa1-83b5-a2ccb1a245b1 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:21.642222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-dbc5608f-bb63-4f19-9bea-86c7de7743e5 req-aacad7d6-f09a-4fa1-83b5-a2ccb1a245b1 service nova] Creating event network-vif-deleted:2482ebe6-1259-4f2f-83d7-763ce7639812 for instance b1243dbb-87ee-43ac-8729-d18c53114d43 on hv-cinder-84130 Jul 07 15:40:21.652309 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-dbc5608f-bb63-4f19-9bea-86c7de7743e5 req-aacad7d6-f09a-4fa1-83b5-a2ccb1a245b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049892 Jul 07 15:40:21.653490 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 482/959] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:22.455046 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-bf990636-caa5-40f9-bd63-ccde013cdd83 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:22.455046 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-bf990636-caa5-40f9-bd63-ccde013cdd83 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:22.463822 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf990636-caa5-40f9-bd63-ccde013cdd83 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:22.467041 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf990636-caa5-40f9-bd63-ccde013cdd83 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:22.467041 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf990636-caa5-40f9-bd63-ccde013cdd83 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:22.467041 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf990636-caa5-40f9-bd63-ccde013cdd83 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:22.491161 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-7e0e323e-26a6-425c-a942-4096f86fd4a5 req-a036ea7c-1b52-4f05-a903-83996c137bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3287e24c-ce40-4bc8-95ac-3361e15b5807", "name": "network-vif-plugged", "status": "completed", "tag": "697451eb-ff82-4b0c-b64d-5fb8cde5a13f"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:40:22.502221 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-7e0e323e-26a6-425c-a942-4096f86fd4a5 req-a036ea7c-1b52-4f05-a903-83996c137bb9 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:22.503042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-7e0e323e-26a6-425c-a942-4096f86fd4a5 req-a036ea7c-1b52-4f05-a903-83996c137bb9 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:22.516613 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-7e0e323e-26a6-425c-a942-4096f86fd4a5 req-a036ea7c-1b52-4f05-a903-83996c137bb9 service nova] Creating event network-vif-plugged:697451eb-ff82-4b0c-b64d-5fb8cde5a13f for instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 on hv-cinder-84130 Jul 07 15:40:22.522405 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-7e0e323e-26a6-425c-a942-4096f86fd4a5 req-a036ea7c-1b52-4f05-a903-83996c137bb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038507 Jul 07 15:40:22.523409 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 483/960] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:40:22.548984 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:22.550170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:22.563216 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:22.563784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:22.564658 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:22.565659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:22.580159 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] HTTP exception thrown: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Request method failure captured: Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 HTTP/1.1 Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy4Bof_843o2DVyTzX5FJ-YmZ3i_HY_vfbxwHjwXODW-3y3CDlMJvP3xz5753SOFCtZ5oMsOoXZcwyDzDaKnMWg4dll3riIL60tL9hC8bhj7vbW3T_IPa1WcFvtWQfLiEHq23wJwKKXOITcPz1aeowoAQW7iysd-0HRlhORRpU3KqM Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:22.581787 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66a98614df914018b7ecfb68afb735c0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b5dec80a83aa463b99bd298ab09dfbdb Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:22.585770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'b1243dbb-87ee-43ac-8729-d18c53114d43'} Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:22.586517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:22.588335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:22.589438 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Returning 404 to user: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:22.589438 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-11848be6-3970-450f-bc7f-e4a18d5c891f tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 404 len: 111 microversion: 2.1 time: 0.041998 Jul 07 15:40:22.589438 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 484/961] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:22 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 15:40:22.592203 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-718524ce-5f7f-4e3e-9e60-ec920ef3f4d5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '.version_select at 0x7f524947b1f0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:22.615606 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-bf990636-caa5-40f9-bd63-ccde013cdd83 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:22.622806 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-bf990636-caa5-40f9-bd63-ccde013cdd83 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.172114 Jul 07 15:40:22.623393 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 478/962] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:22 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:22.692370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-718524ce-5f7f-4e3e-9e60-ec920ef3f4d5 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-694634069" status: 202 len: 0 microversion: 2.1 time: 0.103943 Jul 07 15:40:22.692955 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 485/963] 10.222.0.25 () {58 vars in 1217 bytes} [Thu Jul 7 15:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-694634069 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 15:40:23.134177 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:23.134671 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:23.140597 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:23.141042 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:23.142143 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:23.142384 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:23.155624 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: DELETE /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d HTTP/1.1 Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:40:23.157330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.158915 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'e54a14c0-4b58-4edc-9325-b1c7da38307d'} Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:23.159685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.161483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.162758 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:23.162758 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ca72e7ea-1efa-4614-96f3-023306c56e40 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 404 len: 111 microversion: 2.1 time: 0.028670 Jul 07 15:40:23.162758 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 479/964] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:40:23 2022] DELETE /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:23.169498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:23.170138 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: e54a14c0-4b58-4edc-9325-b1c7da38307d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:23.176953 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:23.182081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:23.182081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:23.182081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:23.193917 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d HTTP/1.1 Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:23.195448 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.196873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'e54a14c0-4b58-4edc-9325-b1c7da38307d'} Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:23.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. Jul 07 15:40:23.198798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:23.200025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance e54a14c0-4b58-4edc-9325-b1c7da38307d could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:23.200025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-69e1d9be-3048-4573-897a-3be414c447b4 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d" status: 404 len: 111 microversion: 2.1 time: 0.032257 Jul 07 15:40:23.200025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 486/965] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:23 2022] GET /compute/v2.1/servers/e54a14c0-4b58-4edc-9325-b1c7da38307d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:23.639960 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a62d581f-eacb-461e-abcf-70f4c4bd92b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:23.641025 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a62d581f-eacb-461e-abcf-70f4c4bd92b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:23.648314 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a62d581f-eacb-461e-abcf-70f4c4bd92b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:23.648761 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a62d581f-eacb-461e-abcf-70f4c4bd92b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:23.649745 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a62d581f-eacb-461e-abcf-70f4c4bd92b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:23.650156 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a62d581f-eacb-461e-abcf-70f4c4bd92b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:23.782843 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a62d581f-eacb-461e-abcf-70f4c4bd92b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:23.790318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a62d581f-eacb-461e-abcf-70f4c4bd92b0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1264 microversion: 2.1 time: 0.154667 Jul 07 15:40:23.790904 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 480/966] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:23 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:24.498789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:24.499331 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:24.505883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.506324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.507077 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.507509 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.521270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: DELETE /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f HTTP/1.1 Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:24.522758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.524460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '285e8356-8fad-43f7-ae21-52104c0b453f'} Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:24.525206 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.526426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.527666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:24.527666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2df0e490-74c8-4c60-9761-b7df79ccfbcc tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 404 len: 111 microversion: 2.1 time: 0.029370 Jul 07 15:40:24.527666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 487/967] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:40:24 2022] DELETE /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:24.532683 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:24.533323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 285e8356-8fad-43f7-ae21-52104c0b453f] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:24.540088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.540534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.541295 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.541732 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.554704 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f HTTP/1.1 Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:40:24.556251 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.557872 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '285e8356-8fad-43f7-ae21-52104c0b453f'} Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:24.558842 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. Jul 07 15:40:24.560471 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.561902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance 285e8356-8fad-43f7-ae21-52104c0b453f could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:24.561902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9fd17116-52ef-428b-9027-b9ea5a427b78 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f" status: 404 len: 111 microversion: 2.1 time: 0.028884 Jul 07 15:40:24.561902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 481/968] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:24 2022] GET /compute/v2.1/servers/285e8356-8fad-43f7-ae21-52104c0b453f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 15:40:24.566030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:24.566522 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:24.572668 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.573113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.573890 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.574332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.587762 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: DELETE /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 HTTP/1.1 Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:24.589254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.590836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '004cd795-a6e3-47b5-ba46-8f24751e8ec2'} Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:24.591750 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.593217 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.594774 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:24.594774 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6f980515-374e-4cce-bfc4-bbf0809d6cc9 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 404 len: 111 microversion: 2.1 time: 0.028560 Jul 07 15:40:24.594774 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 488/969] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:40:24 2022] DELETE /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:24.599644 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:24.600252 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 004cd795-a6e3-47b5-ba46-8f24751e8ec2] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:24.606524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.606965 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.607740 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.608168 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.621465 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 HTTP/1.1 Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:40:24.622937 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.624578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '004cd795-a6e3-47b5-ba46-8f24751e8ec2'} Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:24.625554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. Jul 07 15:40:24.627061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:24.628537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance 004cd795-a6e3-47b5-ba46-8f24751e8ec2 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:24.628537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f5b2dc8f-5aec-4541-b5f7-379426dae7ba tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2" status: 404 len: 111 microversion: 2.1 time: 0.029187 Jul 07 15:40:24.628537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 482/970] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:24 2022] GET /compute/v2.1/servers/004cd795-a6e3-47b5-ba46-8f24751e8ec2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 15:40:24.806998 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-54b5048e-49b3-4cb0-965d-a391480ec31d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:24.807642 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-54b5048e-49b3-4cb0-965d-a391480ec31d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:24.813636 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54b5048e-49b3-4cb0-965d-a391480ec31d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.814077 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54b5048e-49b3-4cb0-965d-a391480ec31d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.814834 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54b5048e-49b3-4cb0-965d-a391480ec31d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.815263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-54b5048e-49b3-4cb0-965d-a391480ec31d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.960608 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-54b5048e-49b3-4cb0-965d-a391480ec31d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:24.968361 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-54b5048e-49b3-4cb0-965d-a391480ec31d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1450 microversion: 2.1 time: 0.165335 Jul 07 15:40:24.968923 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 489/971] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:24 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:24.984992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-44d385ae-e9b0-4944-b747-35e14f237c69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:24.985905 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-44d385ae-e9b0-4944-b747-35e14f237c69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:24.992785 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44d385ae-e9b0-4944-b747-35e14f237c69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.993991 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44d385ae-e9b0-4944-b747-35e14f237c69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:24.993991 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44d385ae-e9b0-4944-b747-35e14f237c69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:24.994368 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-44d385ae-e9b0-4944-b747-35e14f237c69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:25.125214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-44d385ae-e9b0-4944-b747-35e14f237c69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:25.134235 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-44d385ae-e9b0-4944-b747-35e14f237c69 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1450 microversion: 2.1 time: 0.153008 Jul 07 15:40:25.134795 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 483/972] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:24 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:25.927041 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:25.927638 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:25.934292 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:25.934812 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:25.935662 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:25.936176 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:25.950438 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: DELETE /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 HTTP/1.1 Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:25.951874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:25.953219 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '6f1ae649-fd9a-4dcd-ae5a-384e324e4de9'} Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:25.957049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:25.958466 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:25.959699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:25.959699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c2992095-2afe-488b-ad90-c05db8f6f615 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 404 len: 111 microversion: 2.1 time: 0.030763 Jul 07 15:40:25.959699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 490/973] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:40:25 2022] DELETE /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:25.967781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:25.968407 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] [instance: 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:25.977798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:25.978509 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:25.979506 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:25.980020 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:25.980183 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:25.980938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:25.987287 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:26.002949 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:26.002949 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:26.002949 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] HTTP exception thrown: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Request method failure captured: Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 HTTP/1.1 Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy8__ulGtfzxXM7raBEUZ6DeM5TD1hm4EelyxlBgWaxC6mhC1eEFOQ1i9K3gpPSYPn6uO0SvIlRUirefuuNukBkibh0oSsI7ToYhVsa5VBCOR3I7fqQCV5nvny2XgJ-82qqQYb8J1htY5h6pWlSbKE4YmcE2FksYXdI9GR__8KGPqk Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:40:26.003214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66b37250ea6d4c4eb242c27ce9819dfc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66b37250ea6d4c4eb242c27ce9819dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 66b37250ea6d4c4eb242c27ce9819dfc Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1009156429 Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: b2e09539caff4d4698cf29c1ea22d365 Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-AttachVolumeNegativeTest-1009156429-project Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:26.005526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '6f1ae649-fd9a-4dcd-ae5a-384e324e4de9'} Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:26.006427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. Jul 07 15:40:26.008068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.009592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] Returning 404 to user: Instance 6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:26.009592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-084e824d-9a39-4229-baab-abb175989993 tempest-AttachVolumeNegativeTest-1009156429 tempest-AttachVolumeNegativeTest-1009156429-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9" status: 404 len: 111 microversion: 2.1 time: 0.034677 Jul 07 15:40:26.009592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 484/974] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:25 2022] GET /compute/v2.1/servers/6f1ae649-fd9a-4dcd-ae5a-384e324e4de9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] HTTP exception thrown: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Request method failure captured: Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: DELETE /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 HTTP/1.1 Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy4Bof_843o2DVyTzX5FJ-YmZ3i_HY_vfbxwHjwXODW-3y3CDlMJvP3xz5753SOFCtZ5oMsOoXZcwyDzDaKnMWg4dll3riIL60tL9hC8bhj7vbW3T_IPa1WcFvtWQfLiEHq23wJwKKXOITcPz1aeowoAQW7iysd-0HRlhORRpU3KqM Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:26.009925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66a98614df914018b7ecfb68afb735c0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b5dec80a83aa463b99bd298ab09dfbdb Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.012210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'b1243dbb-87ee-43ac-8729-d18c53114d43'} Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:26.013094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.014479 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.015836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Returning 404 to user: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:26.015836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3591f245-140a-48a7-92fa-61561cb309d8 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 404 len: 111 microversion: 2.1 time: 0.030882 Jul 07 15:40:26.015836 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 491/975] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:40:25 2022] DELETE /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 15:40:26.026458 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:26.026458 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: b1243dbb-87ee-43ac-8729-d18c53114d43] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:26.030902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:26.031519 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:26.032482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:26.033545 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:26.047698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] HTTP exception thrown: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Request method failure captured: Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 HTTP/1.1 Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy4Bof_843o2DVyTzX5FJ-YmZ3i_HY_vfbxwHjwXODW-3y3CDlMJvP3xz5753SOFCtZ5oMsOoXZcwyDzDaKnMWg4dll3riIL60tL9hC8bhj7vbW3T_IPa1WcFvtWQfLiEHq23wJwKKXOITcPz1aeowoAQW7iysd-0HRlhORRpU3KqM Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:40:26.049372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66a98614df914018b7ecfb68afb735c0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: b5dec80a83aa463b99bd298ab09dfbdb Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.051276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'b1243dbb-87ee-43ac-8729-d18c53114d43'} Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:26.052753 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. Jul 07 15:40:26.054264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:26.055548 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Returning 404 to user: Instance b1243dbb-87ee-43ac-8729-d18c53114d43 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:26.055548 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b2106fee-949f-4f4a-bf34-a1c94f69b2c6 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43" status: 404 len: 111 microversion: 2.1 time: 0.031978 Jul 07 15:40:26.055548 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 485/976] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:26 2022] GET /compute/v2.1/servers/b1243dbb-87ee-43ac-8729-d18c53114d43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:27.339423 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:27.340004 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:27.350545 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:27.353267 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:27.354249 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:27.355653 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:27.374034 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-be58c9d2-b98b-4a05-964f-e9d5121e25cb req-c59de840-92c5-47fe-a240-49540cbf5c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3287e24c-ce40-4bc8-95ac-3361e15b5807", "tag": "697451eb-ff82-4b0c-b64d-5fb8cde5a13f"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:40:27.384316 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] HTTP exception thrown: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Request method failure captured: Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: DELETE /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a HTTP/1.1 Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy4Bof_843o2DVyTzX5FJ-YmZ3i_HY_vfbxwHjwXODW-3y3CDlMJvP3xz5753SOFCtZ5oMsOoXZcwyDzDaKnMWg4dll3riIL60tL9hC8bhj7vbW3T_IPa1WcFvtWQfLiEHq23wJwKKXOITcPz1aeowoAQW7iysd-0HRlhORRpU3KqM Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:27.386167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66a98614df914018b7ecfb68afb735c0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b5dec80a83aa463b99bd298ab09dfbdb Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.387866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'a5788db1-1101-4334-abdd-2f11d074751a'} Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:27.388755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.390226 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.392750 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-be58c9d2-b98b-4a05-964f-e9d5121e25cb req-c59de840-92c5-47fe-a240-49540cbf5c9e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:27.393119 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Returning 404 to user: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:27.394683 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2e8b327e-b4f8-4c83-8c3f-409ab0dd2366 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 404 len: 111 microversion: 2.1 time: 0.059172 Jul 07 15:40:27.395247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-be58c9d2-b98b-4a05-964f-e9d5121e25cb req-c59de840-92c5-47fe-a240-49540cbf5c9e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:27.395955 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 492/977] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:40:27 2022] DELETE /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:27.405496 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:27.406444 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] [instance: a5788db1-1101-4334-abdd-2f11d074751a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:27.414514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:27.420205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:27.420205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:27.420205 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:27.430898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-be58c9d2-b98b-4a05-964f-e9d5121e25cb req-c59de840-92c5-47fe-a240-49540cbf5c9e service nova] Creating event network-changed:697451eb-ff82-4b0c-b64d-5fb8cde5a13f for instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 on hv-cinder-84130 Jul 07 15:40:27.433521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] HTTP exception thrown: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Request method failure captured: Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a HTTP/1.1 Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy4Bof_843o2DVyTzX5FJ-YmZ3i_HY_vfbxwHjwXODW-3y3CDlMJvP3xz5753SOFCtZ5oMsOoXZcwyDzDaKnMWg4dll3riIL60tL9hC8bhj7vbW3T_IPa1WcFvtWQfLiEHq23wJwKKXOITcPz1aeowoAQW7iysd-0HRlhORRpU3KqM Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:27.435406 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66a98614df914018b7ecfb68afb735c0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66a98614df914018b7ecfb68afb735c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 66a98614df914018b7ecfb68afb735c0 Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-899843982 Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: b5dec80a83aa463b99bd298ab09dfbdb Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeTestJSON-899843982-project Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.436823 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'a5788db1-1101-4334-abdd-2f11d074751a'} Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:27.437553 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. Jul 07 15:40:27.439460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:27.440671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] Returning 404 to user: Instance a5788db1-1101-4334-abdd-2f11d074751a could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:27.440671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-99a2ee8c-6944-4f2a-b622-0ba2e0a28e69 tempest-AttachVolumeTestJSON-899843982 tempest-AttachVolumeTestJSON-899843982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a" status: 404 len: 111 microversion: 2.1 time: 0.037314 Jul 07 15:40:27.440671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 493/978] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:40:27 2022] GET /compute/v2.1/servers/a5788db1-1101-4334-abdd-2f11d074751a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:27.448626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-be58c9d2-b98b-4a05-964f-e9d5121e25cb req-c59de840-92c5-47fe-a240-49540cbf5c9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078901 Jul 07 15:40:27.449264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 486/979] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:40:32.544292 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-85ddabe2-3898-46a5-a37a-835774557b2b tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] Action: 'create', calling method: .version_select at 0x7f524947b550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-92105938", "metadata": {"Type": "work"}}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:40:33.027484 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1885d7e3-7e52-4742-a32b-3933b78c8cca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:33.028529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1885d7e3-7e52-4742-a32b-3933b78c8cca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:33.035270 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1885d7e3-7e52-4742-a32b-3933b78c8cca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:33.035765 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1885d7e3-7e52-4742-a32b-3933b78c8cca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:33.037083 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1885d7e3-7e52-4742-a32b-3933b78c8cca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:33.037522 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1885d7e3-7e52-4742-a32b-3933b78c8cca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:33.067189 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1885d7e3-7e52-4742-a32b-3933b78c8cca tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043936 Jul 07 15:40:33.067682 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 487/980] 10.222.0.25 () {60 vars in 1342 bytes} [Thu Jul 7 15:40:33 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:40:33.135036 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a78dd3da-b7da-44e0-8acd-2032c109fe40 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:33.135609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a78dd3da-b7da-44e0-8acd-2032c109fe40 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:33.141816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a78dd3da-b7da-44e0-8acd-2032c109fe40 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:33.142693 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a78dd3da-b7da-44e0-8acd-2032c109fe40 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:33.143481 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a78dd3da-b7da-44e0-8acd-2032c109fe40 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:33.144258 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a78dd3da-b7da-44e0-8acd-2032c109fe40 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:33.170121 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a78dd3da-b7da-44e0-8acd-2032c109fe40 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Going to try to terminate instance {{(pid=124720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:40:33.227715 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-85ddabe2-3898-46a5-a37a-835774557b2b tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.920218 Jul 07 15:40:33.228341 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 494/981] 10.222.0.25 () {60 vars in 1155 bytes} [Thu Jul 7 15:40:32 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 922 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 07 15:40:33.238965 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cb0f0a02-f47d-475f-a657-ad79718b90be tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] Calling method '.version_select at 0x7f52494f0af0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:33.285426 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cb0f0a02-f47d-475f-a657-ad79718b90be tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7" status: 200 len: 351 microversion: 2.1 time: 0.050189 Jul 07 15:40:33.287880 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 495/982] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:40:33 2022] GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:40:33.479529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a78dd3da-b7da-44e0-8acd-2032c109fe40 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 204 len: 0 microversion: 2.20 time: 0.348116 Jul 07 15:40:33.480154 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 488/983] 10.222.0.25 () {60 vars in 1279 bytes} [Thu Jul 7 15:40:33 2022] DELETE /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 07 15:40:33.490315 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:33.491043 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:33.498258 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:33.498588 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:33.499343 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:33.499853 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:33.648922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:33.656945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:33.658461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:33.659642 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ade8b281-81fa-4a61-a5e8-f907c9909fcc tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.175148 Jul 07 15:40:33.670155 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 496/984] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:40:33 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:40:34.298479 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-40db687d-ce2f-422a-b350-5120e6215b69 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] Calling method '.version_select at 0x7f5248ce7160>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:34.346442 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-40db687d-ce2f-422a-b350-5120e6215b69 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7" status: 200 len: 352 microversion: 2.1 time: 0.052022 Jul 07 15:40:34.347013 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 489/985] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:40:34 2022] GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:34.358241 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0eed19d7-3a78-4207-8792-b9fb78ea331f tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] Calling method '.version_select at 0x7f5249531e50>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:34.414593 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0eed19d7-3a78-4207-8792-b9fb78ea331f tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7" status: 200 len: 352 microversion: 2.1 time: 0.059975 Jul 07 15:40:34.415137 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 497/986] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:40:34 2022] GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:34.435680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-eaf23337-7ee7-411f-9cd9-9e613845dca0 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] Calling method '.version_select at 0x7f5248e6c040>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:34.656243 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-eaf23337-7ee7-411f-9cd9-9e613845dca0 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7" status: 202 len: 0 microversion: 2.1 time: 0.225335 Jul 07 15:40:34.656815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 490/987] 10.222.0.25 () {58 vars in 1247 bytes} [Thu Jul 7 15:40:34 2022] DELETE /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:40:34.665140 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-db3cdab5-c203-4615-ae33-9db4718414b0 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] Calling method '.version_select at 0x7f52494f03a0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:34.678661 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:34.680978 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:34.689810 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:34.690259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:34.691272 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:34.691835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:34.696180 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:34.715465 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-db3cdab5-c203-4615-ae33-9db4718414b0 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7" status: 200 len: 351 microversion: 2.1 time: 0.054581 Jul 07 15:40:34.716083 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 498/988] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:40:34 2022] GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:34.830499 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:34.839640 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:34.841221 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:34.842520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f733ef78-d003-46e7-a28f-99606578dca9 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1722 microversion: 2.20 time: 0.168853 Jul 07 15:40:34.843070 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 491/989] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:40:34 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 15:40:35.728157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-963f7824-983f-41ab-9e6e-ca0f8f1171a3 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] Calling method '.version_select at 0x7f52495a7790>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:35.757094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-963f7824-983f-41ab-9e6e-ca0f8f1171a3 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] HTTP exception thrown: Volume 37f21a6c-acbf-4a06-92c7-4114f7e70aa7 could not be found. Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-963f7824-983f-41ab-9e6e-ca0f8f1171a3 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] Request method failure captured: Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7 HTTP/1.1 Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv5wgpffzI1-00dUWV18AxJwnNYCeZZ2aWxxJ4yZzyHsV20Ti66Nv2gzrdmVFrlYiH1HMbtsEOPOdda1j4yv_dx4IEdRUv6nIcA8Z6XG6ZMCwpoNqOrphfMUH7zGyQSYinmSFDcgfO6WMz4-jqikZYSHJ15vyik1NJRC_pCQKMzicXc Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: 0cc447a829d940d78ebc638f063a3408 Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesGetTestJSON-2017476870 Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:35.759060 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0cc447a829d940d78ebc638f063a3408", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0cc447a829d940d78ebc638f063a3408"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc447a829d940d78ebc638f063a3408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc447a829d940d78ebc638f063a3408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesGetTestJSON-2017476870 Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: 0cc447a829d940d78ebc638f063a3408 Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesGetTestJSON-2017476870 Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesGetTestJSON-2017476870-project Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: f86cfc5a1bd742b8b33d513268d9dc0f Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesGetTestJSON-2017476870-project Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Volume 37f21a6c-acbf-4a06-92c7-4114f7e70aa7 could not be found. Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '37f21a6c-acbf-4a06-92c7-4114f7e70aa7'} Jul 07 15:40:35.763324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37f21a6c-acbf-4a06-92c7-4114f7e70aa7 could not be found. (HTTP 404) (Request-ID: req-584ad944-93eb-480e-9896-a393b4a65561) Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:35.764758 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 15:40:35.766005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37f21a6c-acbf-4a06-92c7-4114f7e70aa7 could not be found. Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 15:40:35.767881 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37f21a6c-acbf-4a06-92c7-4114f7e70aa7 could not be found. Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37f21a6c-acbf-4a06-92c7-4114f7e70aa7 could not be found. Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-963f7824-983f-41ab-9e6e-ca0f8f1171a3 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] Returning 404 to user: Volume 37f21a6c-acbf-4a06-92c7-4114f7e70aa7 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-963f7824-983f-41ab-9e6e-ca0f8f1171a3 tempest-VolumesGetTestJSON-2017476870 tempest-VolumesGetTestJSON-2017476870-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7" status: 404 len: 109 microversion: 2.1 time: 0.037487 Jul 07 15:40:35.770692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 499/990] 10.222.0.25 () {58 vars in 1244 bytes} [Thu Jul 7 15:40:35 2022] GET /compute/v2.1/os-volumes/37f21a6c-acbf-4a06-92c7-4114f7e70aa7 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:40:35.845629 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-13df8b6c-d479-47bf-9a3d-0ed4fad061e3 req-744b0140-70fc-485d-ac01-feb452bc477e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cfd6f9-be72-41c0-8887-1425b3f5565c", "name": "network-vif-deleted", "tag": "cd19f05f-6752-480d-a56b-5d74f03e8e3a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:40:35.857816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-13df8b6c-d479-47bf-9a3d-0ed4fad061e3 req-744b0140-70fc-485d-ac01-feb452bc477e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:35.858259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-13df8b6c-d479-47bf-9a3d-0ed4fad061e3 req-744b0140-70fc-485d-ac01-feb452bc477e service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:35.863600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:35.865077 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:35.872438 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-13df8b6c-d479-47bf-9a3d-0ed4fad061e3 req-744b0140-70fc-485d-ac01-feb452bc477e service nova] Creating event network-vif-deleted:cd19f05f-6752-480d-a56b-5d74f03e8e3a for instance d8cfd6f9-be72-41c0-8887-1425b3f5565c on hv-cinder-84130 Jul 07 15:40:35.872952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:35.873588 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:35.877046 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:35.877046 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:35.879686 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-13df8b6c-d479-47bf-9a3d-0ed4fad061e3 req-744b0140-70fc-485d-ac01-feb452bc477e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038217 Jul 07 15:40:35.882437 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 492/991] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:40:35.960852 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:35.977679 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:35.979673 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2033ad40d45747aa8294e4feb5a6cfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e4afda121042939745304ce6f76a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:40:35.981481 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-30698444-6ab0-4e6b-a0b3-c8719995e98f tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 200 len: 1656 microversion: 2.20 time: 0.124109 Jul 07 15:40:35.983250 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 500/992] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:40:35 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 1656 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 15:40:37.002004 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:37.002698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:37.005682 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:40:37.010777 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:37.011224 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:37.012014 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:37.012449 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:37.031194 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] HTTP exception thrown: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Request method failure captured: Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c HTTP/1.1 Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy5VA9xzUkp0A_TjHipvEzrnzhrmBltWt_8c9jvMfhZlt4rWxAxkq0LZeY7r64b8EuHHf7bQXWeVuRBDubhUVSHTSk7d5tQPA6o6ByIIb-rkFWc2juaRxIURJaUezXTAxc8zhv83qGiZ5yflcSusr3KdNWepH651GVW2DrhV4qpkj0 Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:40:37.033138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2e4afda121042939745304ce6f76a8b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 2033ad40d45747aa8294e4feb5a6cfe0 Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:37.034542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'd8cfd6f9-be72-41c0-8887-1425b3f5565c'} Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:37.035292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:37.037123 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:37.038902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Returning 404 to user: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:37.038902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3a1a0f50-a18c-4fa3-94fa-a3478f84c8a1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 404 len: 111 microversion: 2.20 time: 0.037271 Jul 07 15:40:37.038902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 493/993] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:40:36 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 15:40:37.048776 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-23485cbb-21d1-4a54-9394-69d96424d9f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '.version_select at 0x7f52495d0f70>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:37.137628 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-23485cbb-21d1-4a54-9394-69d96424d9f6 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107894480" status: 204 len: 0 microversion: 2.20 time: 0.096833 Jul 07 15:40:37.138397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 501/994] 10.222.0.25 () {60 vars in 1258 bytes} [Thu Jul 7 15:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107894480 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 15:40:39.195941 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:39.196549 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:39.203955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:39.204404 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:39.205388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:39.205831 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:39.219966 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] HTTP exception thrown: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Request method failure captured: Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: DELETE /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c HTTP/1.1 Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy5VA9xzUkp0A_TjHipvEzrnzhrmBltWt_8c9jvMfhZlt4rWxAxkq0LZeY7r64b8EuHHf7bQXWeVuRBDubhUVSHTSk7d5tQPA6o6ByIIb-rkFWc2juaRxIURJaUezXTAxc8zhv83qGiZ5yflcSusr3KdNWepH651GVW2DrhV4qpkj0 Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:40:39.221524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2e4afda121042939745304ce6f76a8b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 2033ad40d45747aa8294e4feb5a6cfe0 Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.224789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'd8cfd6f9-be72-41c0-8887-1425b3f5565c'} Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:39.225649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.226983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.228457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Returning 404 to user: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:39.228457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-31a301d1-96ec-447d-a3fa-669461a510c1 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 404 len: 111 microversion: 2.20 time: 0.030935 Jul 07 15:40:39.228457 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 494/995] 10.222.0.25 () {60 vars in 1279 bytes} [Thu Jul 7 15:40:39 2022] DELETE /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 15:40:39.233783 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:39.234513 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: d8cfd6f9-be72-41c0-8887-1425b3f5565c] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:39.241321 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:39.241856 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:39.242697 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:39.243218 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:39.259034 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] HTTP exception thrown: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Request method failure captured: Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c HTTP/1.1 Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy5VA9xzUkp0A_TjHipvEzrnzhrmBltWt_8c9jvMfhZlt4rWxAxkq0LZeY7r64b8EuHHf7bQXWeVuRBDubhUVSHTSk7d5tQPA6o6ByIIb-rkFWc2juaRxIURJaUezXTAxc8zhv83qGiZ5yflcSusr3KdNWepH651GVW2DrhV4qpkj0 Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:39.259738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2e4afda121042939745304ce6f76a8b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 2033ad40d45747aa8294e4feb5a6cfe0 Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.261414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'd8cfd6f9-be72-41c0-8887-1425b3f5565c'} Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:39.262243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. Jul 07 15:40:39.263685 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:39.265188 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Returning 404 to user: Instance d8cfd6f9-be72-41c0-8887-1425b3f5565c could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:39.265188 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a304baf6-1084-470b-b9af-bb2a25317deb tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c" status: 404 len: 111 microversion: 2.20 time: 0.031729 Jul 07 15:40:39.265188 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 502/996] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:40:39 2022] GET /compute/v2.1/servers/d8cfd6f9-be72-41c0-8887-1425b3f5565c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 15:40:40.510874 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:40.511454 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:40.518320 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:40.518764 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:40.519515 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:40.519968 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:40.533218 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] HTTP exception thrown: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Request method failure captured: Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: DELETE /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 HTTP/1.1 Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixvy5VA9xzUkp0A_TjHipvEzrnzhrmBltWt_8c9jvMfhZlt4rWxAxkq0LZeY7r64b8EuHHf7bQXWeVuRBDubhUVSHTSk7d5tQPA6o6ByIIb-rkFWc2juaRxIURJaUezXTAxc8zhv83qGiZ5yflcSusr3KdNWepH651GVW2DrhV4qpkj0 Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:40:40.534747 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2e4afda121042939745304ce6f76a8b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 2033ad40d45747aa8294e4feb5a6cfe0 Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.536950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '2e85e6b3-ebad-441e-afcd-31692b27b782'} Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:40.537846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.539207 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.541007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Returning 404 to user: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:40.541007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-86551233-8c3f-4887-8dff-e279f6c16157 tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 404 len: 111 microversion: 2.20 time: 0.029619 Jul 07 15:40:40.541007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 495/997] 10.222.0.25 () {60 vars in 1279 bytes} [Thu Jul 7 15:40:40 2022] DELETE /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 15:40:40.546590 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:40:40.552314 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] [instance: 2e85e6b3-ebad-441e-afcd-31692b27b782] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:40:40.556189 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:40.556780 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:40.557485 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:40:40.557914 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:40:40.571422 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] HTTP exception thrown: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Request method failure captured: Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 HTTP/1.1 Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixvy5VA9xzUkp0A_TjHipvEzrnzhrmBltWt_8c9jvMfhZlt4rWxAxkq0LZeY7r64b8EuHHf7bQXWeVuRBDubhUVSHTSk7d5tQPA6o6ByIIb-rkFWc2juaRxIURJaUezXTAxc8zhv83qGiZ5yflcSusr3KdNWepH651GVW2DrhV4qpkj0 Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:40:40.572966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2e4afda121042939745304ce6f76a8b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2e4afda121042939745304ce6f76a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: d2e4afda121042939745304ce6f76a8b Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-68415346 Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 2033ad40d45747aa8294e4feb5a6cfe0 Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-68415346-project Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.574884 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '2e85e6b3-ebad-441e-afcd-31692b27b782'} Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:40:40.575664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. Jul 07 15:40:40.582122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:40:40.583999 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] Returning 404 to user: Instance 2e85e6b3-ebad-441e-afcd-31692b27b782 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:40:40.583999 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-883754e8-e3f0-4139-95c2-622eb6dd3def tempest-AttachVolumeShelveTestJSON-68415346 tempest-AttachVolumeShelveTestJSON-68415346-project] 10.222.0.25 "GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782" status: 404 len: 111 microversion: 2.20 time: 0.032480 Jul 07 15:40:40.583999 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 503/998] 10.222.0.25 () {60 vars in 1276 bytes} [Thu Jul 7 15:40:40 2022] GET /compute/v2.1/servers/2e85e6b3-ebad-441e-afcd-31692b27b782 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 15:41:41.681697 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-079e5e6b-08a8-4e7e-a03d-3dc03a079480 req-65473237-aebe-44f4-ae7c-ba615a98ff72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8af2eb-fd79-4b8d-a9ef-648a1959ded8", "tag": "bcf3a191-4ef0-4048-9b74-408448e7ee6d"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:41:41.688618 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-614b5e8b-cd28-4a8c-8d3e-94aea41cef05 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:41:41.688618 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-614b5e8b-cd28-4a8c-8d3e-94aea41cef05 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:41:41.694259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=12 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:41:41.703641 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:41:41.706556 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:41:41.710209 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-614b5e8b-cd28-4a8c-8d3e-94aea41cef05 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:41.711002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-614b5e8b-cd28-4a8c-8d3e-94aea41cef05 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:41.715317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-614b5e8b-cd28-4a8c-8d3e-94aea41cef05 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:41.715445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-079e5e6b-08a8-4e7e-a03d-3dc03a079480 req-65473237-aebe-44f4-ae7c-ba615a98ff72 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:41.715445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-079e5e6b-08a8-4e7e-a03d-3dc03a079480 req-65473237-aebe-44f4-ae7c-ba615a98ff72 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:41.715649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-614b5e8b-cd28-4a8c-8d3e-94aea41cef05 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:41.738721 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-079e5e6b-08a8-4e7e-a03d-3dc03a079480 req-65473237-aebe-44f4-ae7c-ba615a98ff72 service nova] Creating event network-changed:bcf3a191-4ef0-4048-9b74-408448e7ee6d for instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 on hv-cinder-84130 Jul 07 15:41:41.746501 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-079e5e6b-08a8-4e7e-a03d-3dc03a079480 req-65473237-aebe-44f4-ae7c-ba615a98ff72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069674 Jul 07 15:41:41.747634 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 504/999] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:41:41.761672 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-614b5e8b-cd28-4a8c-8d3e-94aea41cef05 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Going to try to terminate instance {{(pid=124720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:41:42.084237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-614b5e8b-cd28-4a8c-8d3e-94aea41cef05 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 204 len: 0 microversion: 2.1 time: 0.412927 Jul 07 15:41:42.087558 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 496/1000] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:41:41 2022] DELETE /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:41:42.096168 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2e605996-a4fa-4837-bd18-2a34f3c0d1ca tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:41:42.096856 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2e605996-a4fa-4837-bd18-2a34f3c0d1ca tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:41:42.106363 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e605996-a4fa-4837-bd18-2a34f3c0d1ca tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:42.112838 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e605996-a4fa-4837-bd18-2a34f3c0d1ca tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:42.112838 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e605996-a4fa-4837-bd18-2a34f3c0d1ca tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:42.112838 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2e605996-a4fa-4837-bd18-2a34f3c0d1ca tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:42.113819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:41:42.113819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Thu Jul 7 15:41:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:41:42.403265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-2e605996-a4fa-4837-bd18-2a34f3c0d1ca tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:41:42.412103 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2e605996-a4fa-4837-bd18-2a34f3c0d1ca tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.319821 Jul 07 15:41:42.413071 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 505/1001] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:41:42 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:41:43.432847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-421478ae-9bb5-4372-aa71-b27b703357e3 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:41:43.433609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-421478ae-9bb5-4372-aa71-b27b703357e3 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:41:43.448407 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-421478ae-9bb5-4372-aa71-b27b703357e3 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:43.448857 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-421478ae-9bb5-4372-aa71-b27b703357e3 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:43.455700 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-421478ae-9bb5-4372-aa71-b27b703357e3 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:43.456375 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-421478ae-9bb5-4372-aa71-b27b703357e3 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:43.790065 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-421478ae-9bb5-4372-aa71-b27b703357e3 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:41:43.800181 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-421478ae-9bb5-4372-aa71-b27b703357e3 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1568 microversion: 2.1 time: 0.373507 Jul 07 15:41:43.800776 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 497/1002] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:41:43 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1568 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:41:44.604767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-a1de735e-5d1a-47bc-b66b-c927f179f1c8 req-31af0381-86bf-4d75-802f-c2887fe8f507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8af2eb-fd79-4b8d-a9ef-648a1959ded8", "name": "network-vif-deleted", "tag": "bcf3a191-4ef0-4048-9b74-408448e7ee6d"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:41:44.632214 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-a1de735e-5d1a-47bc-b66b-c927f179f1c8 req-31af0381-86bf-4d75-802f-c2887fe8f507 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:44.633074 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-a1de735e-5d1a-47bc-b66b-c927f179f1c8 req-31af0381-86bf-4d75-802f-c2887fe8f507 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:44.645812 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-a1de735e-5d1a-47bc-b66b-c927f179f1c8 req-31af0381-86bf-4d75-802f-c2887fe8f507 service nova] Creating event network-vif-deleted:bcf3a191-4ef0-4048-9b74-408448e7ee6d for instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 on hv-cinder-84130 Jul 07 15:41:44.652437 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-a1de735e-5d1a-47bc-b66b-c927f179f1c8 req-31af0381-86bf-4d75-802f-c2887fe8f507 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051998 Jul 07 15:41:44.656404 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 506/1003] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:41:44.823586 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ec76d296-7384-40bc-b57b-ab71a5a3d979 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:41:44.824201 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ec76d296-7384-40bc-b57b-ab71a5a3d979 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:41:44.843866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ec76d296-7384-40bc-b57b-ab71a5a3d979 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:44.843866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ec76d296-7384-40bc-b57b-ab71a5a3d979 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:44.843866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ec76d296-7384-40bc-b57b-ab71a5a3d979 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:44.843866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ec76d296-7384-40bc-b57b-ab71a5a3d979 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:44.992849 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ec76d296-7384-40bc-b57b-ab71a5a3d979 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:41:45.002705 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ec76d296-7384-40bc-b57b-ab71a5a3d979 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1219 microversion: 2.1 time: 0.189689 Jul 07 15:41:45.003415 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 498/1004] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:41:44 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1219 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:41:46.022074 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:41:46.029157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:41:46.038192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:46.039922 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:46.040927 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:46.042878 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:46.095498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:46.096184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:46.097079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lazy-loading 'fault' on Instance uuid 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:41:46.172633 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7231c86e1a4c4bb851f317a935079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41be827d61314cdbb5387c24e6353bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:41:46.204775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3bb5ac70-aa30-49e7-8aff-750e5fa40688 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 200 len: 1224 microversion: 2.1 time: 0.185556 Jul 07 15:41:46.211150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 507/1005] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:41:46 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 1224 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:41:47.224096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:41:47.225599 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] [instance: 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:41:47.235638 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:47.240759 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:47.242461 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:47.242461 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:47.272491 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] HTTP exception thrown: Instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 could not be found. Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Request method failure captured: Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 HTTP/1.1 Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv1fK0AmmEdtbuWE3L6CJyXsmWKXdOUTqMm88bqKnhove4qkr4LroFmILDpuUn6Irs6HS8CmZoqTx-0qJtX9ZJjZLBUyZVvKRogLjbfCM1i4ywXKvlG1CVc8eaARnyu8DbTRIYEWNgLOsMP44siC52V6wX9SLG3CvJYP7PXMTVrODoY Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 41be827d61314cdbb5387c24e6353bb5 Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-TestShelveInstance-932347221 Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:41:47.275908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41be827d61314cdbb5387c24e6353bb5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41be827d61314cdbb5387c24e6353bb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41be827d61314cdbb5387c24e6353bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41be827d61314cdbb5387c24e6353bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-TestShelveInstance-932347221 Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 41be827d61314cdbb5387c24e6353bb5 Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-TestShelveInstance-932347221 Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-TestShelveInstance-932347221-project Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 4a7231c86e1a4c4bb851f317a935079d Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-TestShelveInstance-932347221-project Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 could not be found. Jul 07 15:41:47.277448 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '9b8af2eb-fd79-4b8d-a9ef-648a1959ded8'} Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 could not be found. Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:41:47.278346 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 could not be found. Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 could not be found. Jul 07 15:41:47.279819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:41:47.281611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Returning 404 to user: Instance 9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:41:47.283695 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-80f14bc6-aae6-4e5d-b8a0-8d7ccf2cde22 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8" status: 404 len: 111 microversion: 2.1 time: 0.063156 Jul 07 15:41:47.288440 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 499/1006] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:41:47 2022] GET /compute/v2.1/servers/9b8af2eb-fd79-4b8d-a9ef-648a1959ded8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:41:47.612790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2e3fd5a1-afce-4242-ab79-3b2e0f7cd341 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] Calling method '.version_select at 0x7f52495a7a60>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:41:47.719865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2e3fd5a1-afce-4242-ab79-3b2e0f7cd341 tempest-TestShelveInstance-932347221 tempest-TestShelveInstance-932347221-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-888789777" status: 202 len: 0 microversion: 2.1 time: 0.105264 Jul 07 15:41:47.719865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 508/1007] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Jul 7 15:41:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-888789777 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:41:56.544891 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1686267126", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "networks": [{"uuid": "9da41ecc-09e3-4587-b0bc-9b4f13d625d5"}]}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:41:56.617061 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] validate_networks() for [('9da41ecc-09e3-4587-b0bc-9b4f13d625d5', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:41:57.256572 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:41:57.376898 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:41:57.377548 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:41:57.378328 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:41:57.379711 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:41:57.380289 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:41:57.410586 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:57.411311 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:57.412295 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:57.412880 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:57.490688 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Getting quotas for project f90b44820e424210b4dea0abc23ea469. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:41:57.501488 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Getting quotas for user 03f8ed4d3d5a4447ba2c61b3dd4c314a and project f90b44820e424210b4dea0abc23ea469. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:41:57.530059 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:41:57.536572 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:41:57.658953 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-363fb873-2572-47dd-b41c-4763ac2af38c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120702 Jul 07 15:41:57.663193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 500/1008] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:41:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:41:57.677461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=18 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:41:57.679694 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:41:57.685798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ac239e23-c51c-4230-8a4f-d9425b8a7578 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:41:57.686419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ac239e23-c51c-4230-8a4f-d9425b8a7578 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:41:57.799095 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ac239e23-c51c-4230-8a4f-d9425b8a7578 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:41:57.818244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ac239e23-c51c-4230-8a4f-d9425b8a7578 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1214 microversion: 2.1 time: 0.132026 Jul 07 15:41:57.819170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 509/1009] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:41:57 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:41:58.842175 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6591bb25-a4d2-4cec-a0a0-08ab926fd438 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:41:58.845444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6591bb25-a4d2-4cec-a0a0-08ab926fd438 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:41:58.853650 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6591bb25-a4d2-4cec-a0a0-08ab926fd438 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:58.854348 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6591bb25-a4d2-4cec-a0a0-08ab926fd438 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:58.855680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6591bb25-a4d2-4cec-a0a0-08ab926fd438 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:41:58.856276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6591bb25-a4d2-4cec-a0a0-08ab926fd438 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:41:59.000151 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6591bb25-a4d2-4cec-a0a0-08ab926fd438 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:41:59.015776 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6591bb25-a4d2-4cec-a0a0-08ab926fd438 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1218 microversion: 2.1 time: 0.182698 Jul 07 15:41:59.017974 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 501/1010] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:41:58 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:00.039830 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-116e3f80-c924-4ebe-abfe-b86a223206cc tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:00.041094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-116e3f80-c924-4ebe-abfe-b86a223206cc tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:00.061326 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e3f80-c924-4ebe-abfe-b86a223206cc tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:00.064359 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e3f80-c924-4ebe-abfe-b86a223206cc tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:00.066763 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e3f80-c924-4ebe-abfe-b86a223206cc tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:00.069538 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-116e3f80-c924-4ebe-abfe-b86a223206cc tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:00.178030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-116e3f80-c924-4ebe-abfe-b86a223206cc tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:00.216246 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-116e3f80-c924-4ebe-abfe-b86a223206cc tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1266 microversion: 2.1 time: 0.179151 Jul 07 15:42:00.220809 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 510/1011] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:00 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:01.238860 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cff7df5b-a44a-4cd9-b07d-cf77ce922676 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:01.240310 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cff7df5b-a44a-4cd9-b07d-cf77ce922676 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:01.254837 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cff7df5b-a44a-4cd9-b07d-cf77ce922676 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:01.255540 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cff7df5b-a44a-4cd9-b07d-cf77ce922676 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:01.262585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cff7df5b-a44a-4cd9-b07d-cf77ce922676 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:01.263262 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cff7df5b-a44a-4cd9-b07d-cf77ce922676 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:01.541418 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cff7df5b-a44a-4cd9-b07d-cf77ce922676 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:01.551345 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cff7df5b-a44a-4cd9-b07d-cf77ce922676 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1314 microversion: 2.1 time: 0.317800 Jul 07 15:42:01.552264 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 502/1012] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:01 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:02.575472 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1b633b38-8d4a-43ec-ba31-c01c5247b9b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:02.576150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1b633b38-8d4a-43ec-ba31-c01c5247b9b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:02.590628 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b633b38-8d4a-43ec-ba31-c01c5247b9b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:02.591458 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b633b38-8d4a-43ec-ba31-c01c5247b9b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:02.592452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b633b38-8d4a-43ec-ba31-c01c5247b9b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:02.593101 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b633b38-8d4a-43ec-ba31-c01c5247b9b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:02.769098 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-5487c0e3-9c3a-49ad-8e51-8ab480b4a706 req-9f7c7b49-45a0-4846-aa56-7e0167a0dd54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8c6850-8369-499b-9f86-95bf45d62118", "tag": "8bba30e1-7679-4246-b545-3dc79513c8c8"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:02.785553 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-5487c0e3-9c3a-49ad-8e51-8ab480b4a706 req-9f7c7b49-45a0-4846-aa56-7e0167a0dd54 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:02.785675 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-5487c0e3-9c3a-49ad-8e51-8ab480b4a706 req-9f7c7b49-45a0-4846-aa56-7e0167a0dd54 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:02.798387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-5487c0e3-9c3a-49ad-8e51-8ab480b4a706 req-9f7c7b49-45a0-4846-aa56-7e0167a0dd54 service nova] Creating event network-changed:8bba30e1-7679-4246-b545-3dc79513c8c8 for instance 8f8c6850-8369-499b-9f86-95bf45d62118 on hv-cinder-84130 Jul 07 15:42:02.806788 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-5487c0e3-9c3a-49ad-8e51-8ab480b4a706 req-9f7c7b49-45a0-4846-aa56-7e0167a0dd54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040771 Jul 07 15:42:02.808623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 503/1013] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:42:02.902775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1b633b38-8d4a-43ec-ba31-c01c5247b9b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:02.913567 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1b633b38-8d4a-43ec-ba31-c01c5247b9b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1314 microversion: 2.1 time: 0.342540 Jul 07 15:42:02.919852 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 511/1014] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:02 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:03.934463 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-07303e16-dcbd-4743-bf7e-a2139173d4e1 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:03.935909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-07303e16-dcbd-4743-bf7e-a2139173d4e1 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:03.943080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07303e16-dcbd-4743-bf7e-a2139173d4e1 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:03.943533 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07303e16-dcbd-4743-bf7e-a2139173d4e1 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:03.944367 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07303e16-dcbd-4743-bf7e-a2139173d4e1 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:03.944986 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-07303e16-dcbd-4743-bf7e-a2139173d4e1 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:04.349734 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-07303e16-dcbd-4743-bf7e-a2139173d4e1 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:04.357709 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-07303e16-dcbd-4743-bf7e-a2139173d4e1 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1314 microversion: 2.1 time: 0.427495 Jul 07 15:42:04.358277 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 504/1015] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:03 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:05.377149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1cef548d-f7c1-42a2-a105-30988e67f287 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:05.378749 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1cef548d-f7c1-42a2-a105-30988e67f287 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:05.386907 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1cef548d-f7c1-42a2-a105-30988e67f287 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:05.387817 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1cef548d-f7c1-42a2-a105-30988e67f287 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:05.391812 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1cef548d-f7c1-42a2-a105-30988e67f287 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:05.392543 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1cef548d-f7c1-42a2-a105-30988e67f287 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:05.617079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1cef548d-f7c1-42a2-a105-30988e67f287 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:05.628158 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1cef548d-f7c1-42a2-a105-30988e67f287 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1314 microversion: 2.1 time: 0.257348 Jul 07 15:42:05.628828 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 512/1016] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:05 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:06.646224 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0c55a702-b846-4d81-b9d7-b0ab781b28c0 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:06.647601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0c55a702-b846-4d81-b9d7-b0ab781b28c0 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:06.654749 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0c55a702-b846-4d81-b9d7-b0ab781b28c0 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:06.655204 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0c55a702-b846-4d81-b9d7-b0ab781b28c0 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:06.656011 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0c55a702-b846-4d81-b9d7-b0ab781b28c0 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:06.656638 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0c55a702-b846-4d81-b9d7-b0ab781b28c0 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:06.808432 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0c55a702-b846-4d81-b9d7-b0ab781b28c0 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:06.817316 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0c55a702-b846-4d81-b9d7-b0ab781b28c0 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1314 microversion: 2.1 time: 0.175212 Jul 07 15:42:06.827154 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 505/1017] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:06 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:07.834290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8f02e255-50d2-40c7-828a-9a5007b3f93f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:07.835598 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8f02e255-50d2-40c7-828a-9a5007b3f93f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:07.842334 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:07.846763 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f02e255-50d2-40c7-828a-9a5007b3f93f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:07.847204 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f02e255-50d2-40c7-828a-9a5007b3f93f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:07.848000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f02e255-50d2-40c7-828a-9a5007b3f93f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:07.848546 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8f02e255-50d2-40c7-828a-9a5007b3f93f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:08.006222 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8f02e255-50d2-40c7-828a-9a5007b3f93f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:08.014849 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8f02e255-50d2-40c7-828a-9a5007b3f93f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1314 microversion: 2.1 time: 0.184367 Jul 07 15:42:08.025240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 513/1018] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:07 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:08.498895 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ced205a8-adb7-4876-9f8b-3e091c7bec5e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Action: 'create', calling method: .version_select at 0x7f5248ce7160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1924457698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARPgf4TtBFqpeJENSR/FmoVGSUWWA1UozAn04WLvPy2HJ5lgjz8GWdoAPOu1/VgRKsLy8BLwMUNSWgjeQ6I8P505MTwwnMvGQ7mfZWRAJwNNqAWg+H6tnjYadxOCVjZyg=="}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:08.502909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:08.503588 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=6 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:08.514406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-ced205a8-adb7-4876-9f8b-3e091c7bec5e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Getting quotas for project 0b2770b1b56d4f0ea8c3c1759a8e504f. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:42:08.518088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-ced205a8-adb7-4876-9f8b-3e091c7bec5e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Getting quotas for user 975faecf991a41f4b116537b39e04d3c and project 0b2770b1b56d4f0ea8c3c1759a8e504f. Resources: {'key_pairs'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:42:08.592788 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ced205a8-adb7-4876-9f8b-3e091c7bec5e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.097701 Jul 07 15:42:08.593368 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 506/1019] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Jul 7 15:42:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:08.697353 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-701218873", "imageRef": "85df6fd3-f169-4ab6-9099-09154239a570", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1924457698", "networks": [{"uuid": "1a1eb1fc-380d-4506-bbe7-97afbc3bfb10"}]}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:08.746521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.network.neutron [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] validate_networks() for [('1a1eb1fc-380d-4506-bbe7-97afbc3bfb10', None, None, None, None, None)] {{(pid=124719) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:42:08.963680 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-faed13c2-ce7f-4267-a27c-731d9943f5e2 req-f7518194-baaa-44b3-9571-b522e838e4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8c6850-8369-499b-9f86-95bf45d62118", "name": "network-vif-plugged", "status": "completed", "tag": "8bba30e1-7679-4246-b545-3dc79513c8c8"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:08.974366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-faed13c2-ce7f-4267-a27c-731d9943f5e2 req-f7518194-baaa-44b3-9571-b522e838e4e3 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:08.974846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-faed13c2-ce7f-4267-a27c-731d9943f5e2 req-f7518194-baaa-44b3-9571-b522e838e4e3 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:08.986561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-faed13c2-ce7f-4267-a27c-731d9943f5e2 req-f7518194-baaa-44b3-9571-b522e838e4e3 service nova] Creating event network-vif-plugged:8bba30e1-7679-4246-b545-3dc79513c8c8 for instance 8f8c6850-8369-499b-9f86-95bf45d62118 on hv-cinder-84130 Jul 07 15:42:08.992067 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-faed13c2-ce7f-4267-a27c-731d9943f5e2 req-f7518194-baaa-44b3-9571-b522e838e4e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036025 Jul 07 15:42:08.992732 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 507/1020] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:09.033557 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d838db2b-0518-44c3-b674-0f54a5dfae37 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:09.034177 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d838db2b-0518-44c3-b674-0f54a5dfae37 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:09.042317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d838db2b-0518-44c3-b674-0f54a5dfae37 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:09.042766 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d838db2b-0518-44c3-b674-0f54a5dfae37 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:09.043529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d838db2b-0518-44c3-b674-0f54a5dfae37 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:09.043979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d838db2b-0518-44c3-b674-0f54a5dfae37 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:09.166686 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Flavor limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:42:09.167151 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Image limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:42:09.167719 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Flavor pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:42:09.168119 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Image pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:42:09.168523 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:42:09.177501 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:09.177938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:09.178753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:09.179177 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:09.196999 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Getting quotas for project 0b2770b1b56d4f0ea8c3c1759a8e504f. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:42:09.201045 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Getting quotas for user 975faecf991a41f4b116537b39e04d3c and project 0b2770b1b56d4f0ea8c3c1759a8e504f. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:42:09.213359 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Going to run 1 instances... {{(pid=124719) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:42:09.215777 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85df6fd3-f169-4ab6-9099-09154239a570',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:42:09.230397 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d838db2b-0518-44c3-b674-0f54a5dfae37 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:09.239301 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d838db2b-0518-44c3-b674-0f54a5dfae37 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1314 microversion: 2.1 time: 0.210364 Jul 07 15:42:09.240168 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 508/1021] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:09 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:09.308056 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3802cb7a-29c1-48b3-916c-d2f7d83a1bd0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614483 Jul 07 15:42:09.308698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 514/1022] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:42:09.321281 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-faa724e8-eaac-4042-a821-267c68d071e4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:09.322073 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-faa724e8-eaac-4042-a821-267c68d071e4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:09.386474 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-faa724e8-eaac-4042-a821-267c68d071e4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:09.393914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-faa724e8-eaac-4042-a821-267c68d071e4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1258 microversion: 2.1 time: 0.078424 Jul 07 15:42:09.394586 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 509/1023] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:09 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:10.257117 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-677fbfe0-764e-4daa-aa8c-81f25d0f697e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:10.257722 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-677fbfe0-764e-4daa-aa8c-81f25d0f697e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:10.264436 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-677fbfe0-764e-4daa-aa8c-81f25d0f697e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:10.264878 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-677fbfe0-764e-4daa-aa8c-81f25d0f697e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:10.265667 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-677fbfe0-764e-4daa-aa8c-81f25d0f697e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:10.266156 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-677fbfe0-764e-4daa-aa8c-81f25d0f697e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:10.398794 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-677fbfe0-764e-4daa-aa8c-81f25d0f697e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:10.406208 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-677fbfe0-764e-4daa-aa8c-81f25d0f697e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1314 microversion: 2.1 time: 0.154023 Jul 07 15:42:10.406775 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 515/1024] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:10 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:10.411529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-165f5ea9-719d-4c1c-80cb-938d18546f05 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:10.412167 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-165f5ea9-719d-4c1c-80cb-938d18546f05 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:10.421100 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-165f5ea9-719d-4c1c-80cb-938d18546f05 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:10.421546 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-165f5ea9-719d-4c1c-80cb-938d18546f05 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:10.422306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-165f5ea9-719d-4c1c-80cb-938d18546f05 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:10.422736 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-165f5ea9-719d-4c1c-80cb-938d18546f05 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:10.485474 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-165f5ea9-719d-4c1c-80cb-938d18546f05 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:10.493689 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-165f5ea9-719d-4c1c-80cb-938d18546f05 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1262 microversion: 2.1 time: 0.086004 Jul 07 15:42:10.494247 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 510/1025] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:10 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:11.422126 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-33853390-001b-4985-890a-e8448bd29f34 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:11.422732 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-33853390-001b-4985-890a-e8448bd29f34 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:11.429835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-33853390-001b-4985-890a-e8448bd29f34 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:11.430464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-33853390-001b-4985-890a-e8448bd29f34 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:11.431235 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-33853390-001b-4985-890a-e8448bd29f34 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:11.431692 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-33853390-001b-4985-890a-e8448bd29f34 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:11.511951 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5e8b1460-1dc4-4788-bf3b-82de1f973bdc tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:11.512651 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5e8b1460-1dc4-4788-bf3b-82de1f973bdc tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:11.518903 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5e8b1460-1dc4-4788-bf3b-82de1f973bdc tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:11.519922 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5e8b1460-1dc4-4788-bf3b-82de1f973bdc tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:11.520142 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5e8b1460-1dc4-4788-bf3b-82de1f973bdc tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:11.520602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5e8b1460-1dc4-4788-bf3b-82de1f973bdc tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:11.573505 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-33853390-001b-4985-890a-e8448bd29f34 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:11.580898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-33853390-001b-4985-890a-e8448bd29f34 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1498 microversion: 2.1 time: 0.162605 Jul 07 15:42:11.581464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 516/1026] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:11 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:11.589798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-5e8b1460-1dc4-4788-bf3b-82de1f973bdc tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:11.597300 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5e8b1460-1dc4-4788-bf3b-82de1f973bdc tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1254 microversion: 2.1 time: 0.090376 Jul 07 15:42:11.597867 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 511/1027] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:11 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1254 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:12.453662 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a3c15841-2fdf-430d-8fad-46b850869d4f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:12.454147 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a3c15841-2fdf-430d-8fad-46b850869d4f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:12.460835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a3c15841-2fdf-430d-8fad-46b850869d4f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:12.461284 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a3c15841-2fdf-430d-8fad-46b850869d4f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:12.462049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a3c15841-2fdf-430d-8fad-46b850869d4f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:12.462487 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a3c15841-2fdf-430d-8fad-46b850869d4f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:12.490776 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a3c15841-2fdf-430d-8fad-46b850869d4f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:42:12.614470 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-847f14aa-12cc-4c74-85cd-a7bce078da7e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:12.615064 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-847f14aa-12cc-4c74-85cd-a7bce078da7e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:12.617481 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:12.622311 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-847f14aa-12cc-4c74-85cd-a7bce078da7e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:12.622754 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-847f14aa-12cc-4c74-85cd-a7bce078da7e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:12.623510 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-847f14aa-12cc-4c74-85cd-a7bce078da7e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:12.623964 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-847f14aa-12cc-4c74-85cd-a7bce078da7e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:12.692128 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-847f14aa-12cc-4c74-85cd-a7bce078da7e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:12.699786 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-847f14aa-12cc-4c74-85cd-a7bce078da7e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1328 microversion: 2.1 time: 0.089490 Jul 07 15:42:12.700360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 512/1028] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:12 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:12.912599 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a3c15841-2fdf-430d-8fad-46b850869d4f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 204 len: 0 microversion: 2.1 time: 0.462631 Jul 07 15:42:12.913462 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 517/1029] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:42:12 2022] DELETE /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 07 15:42:12.922374 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7701c1de-af3c-437f-879c-8a6223dda661 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:12.922487 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7701c1de-af3c-437f-879c-8a6223dda661 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:12.928936 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7701c1de-af3c-437f-879c-8a6223dda661 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:12.929381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7701c1de-af3c-437f-879c-8a6223dda661 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:12.930197 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7701c1de-af3c-437f-879c-8a6223dda661 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:12.930633 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7701c1de-af3c-437f-879c-8a6223dda661 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:13.151950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7701c1de-af3c-437f-879c-8a6223dda661 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:13.159730 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7701c1de-af3c-437f-879c-8a6223dda661 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1504 microversion: 2.1 time: 0.241797 Jul 07 15:42:13.160309 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 513/1030] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:12 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:13.717338 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5b21c216-8512-45e6-bdcd-7ffa6f18f3f3 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:13.718030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5b21c216-8512-45e6-bdcd-7ffa6f18f3f3 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:13.724730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5b21c216-8512-45e6-bdcd-7ffa6f18f3f3 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:13.725169 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5b21c216-8512-45e6-bdcd-7ffa6f18f3f3 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:13.726451 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5b21c216-8512-45e6-bdcd-7ffa6f18f3f3 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:13.726874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5b21c216-8512-45e6-bdcd-7ffa6f18f3f3 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:13.852862 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5b21c216-8512-45e6-bdcd-7ffa6f18f3f3 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:13.860279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5b21c216-8512-45e6-bdcd-7ffa6f18f3f3 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.147196 Jul 07 15:42:13.860851 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 518/1031] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:13 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:14.177142 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d5fbbf8a-72b2-41ce-9a05-094e034290cb tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:14.177781 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d5fbbf8a-72b2-41ce-9a05-094e034290cb tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:14.185028 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d5fbbf8a-72b2-41ce-9a05-094e034290cb tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:14.185489 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d5fbbf8a-72b2-41ce-9a05-094e034290cb tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:14.186273 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d5fbbf8a-72b2-41ce-9a05-094e034290cb tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:14.186713 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d5fbbf8a-72b2-41ce-9a05-094e034290cb tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:14.329756 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d5fbbf8a-72b2-41ce-9a05-094e034290cb tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:14.338510 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d5fbbf8a-72b2-41ce-9a05-094e034290cb tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1504 microversion: 2.1 time: 0.165191 Jul 07 15:42:14.339095 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 514/1032] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:14 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:14.878257 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-628dc1f2-e4db-43d4-9b78-98bd88547435 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:14.878869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-628dc1f2-e4db-43d4-9b78-98bd88547435 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:14.886313 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-628dc1f2-e4db-43d4-9b78-98bd88547435 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:14.886759 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-628dc1f2-e4db-43d4-9b78-98bd88547435 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:14.887532 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-628dc1f2-e4db-43d4-9b78-98bd88547435 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:14.888009 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-628dc1f2-e4db-43d4-9b78-98bd88547435 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:15.031285 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-628dc1f2-e4db-43d4-9b78-98bd88547435 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:15.038866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-628dc1f2-e4db-43d4-9b78-98bd88547435 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.164424 Jul 07 15:42:15.048516 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 519/1033] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:14 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:15.356081 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7e699c04-02ec-4a6e-96f0-0fc935444b6c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:15.356829 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7e699c04-02ec-4a6e-96f0-0fc935444b6c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:15.364389 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e699c04-02ec-4a6e-96f0-0fc935444b6c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:15.365441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e699c04-02ec-4a6e-96f0-0fc935444b6c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:15.365871 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e699c04-02ec-4a6e-96f0-0fc935444b6c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:15.366869 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7e699c04-02ec-4a6e-96f0-0fc935444b6c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:15.517460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7e699c04-02ec-4a6e-96f0-0fc935444b6c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:15.526077 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7e699c04-02ec-4a6e-96f0-0fc935444b6c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1504 microversion: 2.1 time: 0.173850 Jul 07 15:42:15.526672 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 515/1034] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:15 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:16.055755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-70e10493-c865-4b77-a66b-aa8fff9d825f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:16.056360 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-70e10493-c865-4b77-a66b-aa8fff9d825f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:16.062819 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-70e10493-c865-4b77-a66b-aa8fff9d825f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:16.063265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-70e10493-c865-4b77-a66b-aa8fff9d825f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:16.064055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-70e10493-c865-4b77-a66b-aa8fff9d825f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:16.064495 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-70e10493-c865-4b77-a66b-aa8fff9d825f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:16.205869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-70e10493-c865-4b77-a66b-aa8fff9d825f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:16.214300 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-70e10493-c865-4b77-a66b-aa8fff9d825f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.162493 Jul 07 15:42:16.214870 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 520/1035] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:16 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:16.543804 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a0873528-d2ab-4cff-9609-e1a46c8de1e3 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:16.544549 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a0873528-d2ab-4cff-9609-e1a46c8de1e3 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:16.550950 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a0873528-d2ab-4cff-9609-e1a46c8de1e3 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:16.551396 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a0873528-d2ab-4cff-9609-e1a46c8de1e3 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:16.552189 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a0873528-d2ab-4cff-9609-e1a46c8de1e3 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:16.552626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a0873528-d2ab-4cff-9609-e1a46c8de1e3 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:16.687080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a0873528-d2ab-4cff-9609-e1a46c8de1e3 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:16.695134 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a0873528-d2ab-4cff-9609-e1a46c8de1e3 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1504 microversion: 2.1 time: 0.154755 Jul 07 15:42:16.695835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 516/1036] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:16 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:17.233788 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-acedd4b5-b66b-4267-91b2-7f3b6935aec4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:17.234499 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-acedd4b5-b66b-4267-91b2-7f3b6935aec4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:17.240950 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-acedd4b5-b66b-4267-91b2-7f3b6935aec4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:17.241919 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-acedd4b5-b66b-4267-91b2-7f3b6935aec4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:17.242741 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-acedd4b5-b66b-4267-91b2-7f3b6935aec4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:17.243170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-acedd4b5-b66b-4267-91b2-7f3b6935aec4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:17.393356 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-acedd4b5-b66b-4267-91b2-7f3b6935aec4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:17.401132 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-acedd4b5-b66b-4267-91b2-7f3b6935aec4 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.172826 Jul 07 15:42:17.410984 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 521/1037] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:17 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:17.712361 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8ca115bf-69e0-42dc-ba99-e188677fe3b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:17.712973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8ca115bf-69e0-42dc-ba99-e188677fe3b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:17.719860 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8ca115bf-69e0-42dc-ba99-e188677fe3b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:17.720306 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8ca115bf-69e0-42dc-ba99-e188677fe3b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:17.721220 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8ca115bf-69e0-42dc-ba99-e188677fe3b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:17.721764 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8ca115bf-69e0-42dc-ba99-e188677fe3b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:17.862975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8ca115bf-69e0-42dc-ba99-e188677fe3b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:17.871433 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8ca115bf-69e0-42dc-ba99-e188677fe3b6 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1504 microversion: 2.1 time: 0.162710 Jul 07 15:42:17.872026 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 517/1038] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:17 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:18.417496 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-abf5b990-d641-4f90-806e-3289cf391ec1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:18.420315 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-abf5b990-d641-4f90-806e-3289cf391ec1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:18.424804 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-abf5b990-d641-4f90-806e-3289cf391ec1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:18.425257 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-abf5b990-d641-4f90-806e-3289cf391ec1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:18.426028 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-abf5b990-d641-4f90-806e-3289cf391ec1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:18.426463 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-abf5b990-d641-4f90-806e-3289cf391ec1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:18.567809 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-abf5b990-d641-4f90-806e-3289cf391ec1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:18.577370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-abf5b990-d641-4f90-806e-3289cf391ec1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.163450 Jul 07 15:42:18.588723 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 522/1039] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:18 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:18.889738 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-353d7376-fb4d-4180-a84d-8a17d8b8db12 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:18.890469 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-353d7376-fb4d-4180-a84d-8a17d8b8db12 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:18.898111 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-353d7376-fb4d-4180-a84d-8a17d8b8db12 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:18.898555 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-353d7376-fb4d-4180-a84d-8a17d8b8db12 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:18.899324 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-353d7376-fb4d-4180-a84d-8a17d8b8db12 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:18.899795 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-353d7376-fb4d-4180-a84d-8a17d8b8db12 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:19.057800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-353d7376-fb4d-4180-a84d-8a17d8b8db12 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:19.073801 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-353d7376-fb4d-4180-a84d-8a17d8b8db12 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1504 microversion: 2.1 time: 0.188032 Jul 07 15:42:19.074493 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 518/1040] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:18 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:19.597806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d6cf2716-c55d-4fc6-b755-503d82881b1b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:19.598442 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d6cf2716-c55d-4fc6-b755-503d82881b1b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:19.600356 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:19.601064 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=6 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:19.606471 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d6cf2716-c55d-4fc6-b755-503d82881b1b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:19.607239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d6cf2716-c55d-4fc6-b755-503d82881b1b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:19.608051 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d6cf2716-c55d-4fc6-b755-503d82881b1b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:19.608477 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d6cf2716-c55d-4fc6-b755-503d82881b1b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:19.766447 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d6cf2716-c55d-4fc6-b755-503d82881b1b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:19.776073 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d6cf2716-c55d-4fc6-b755-503d82881b1b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.182770 Jul 07 15:42:19.776642 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 523/1041] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:19 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:20.092141 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-78436874-bf4e-4ca7-b36c-4e1707335293 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:20.092762 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-78436874-bf4e-4ca7-b36c-4e1707335293 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:20.094758 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=6 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:20.100132 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-78436874-bf4e-4ca7-b36c-4e1707335293 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:20.101229 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-78436874-bf4e-4ca7-b36c-4e1707335293 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:20.102483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-78436874-bf4e-4ca7-b36c-4e1707335293 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:20.102483 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-78436874-bf4e-4ca7-b36c-4e1707335293 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:20.248725 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-78436874-bf4e-4ca7-b36c-4e1707335293 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:20.258566 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-78436874-bf4e-4ca7-b36c-4e1707335293 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1504 microversion: 2.1 time: 0.170010 Jul 07 15:42:20.268213 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 519/1042] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:20 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:20.793618 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-067df7e2-6814-46f6-92ab-a8db5445670c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:20.794281 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-067df7e2-6814-46f6-92ab-a8db5445670c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:20.801075 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-067df7e2-6814-46f6-92ab-a8db5445670c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:20.801527 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-067df7e2-6814-46f6-92ab-a8db5445670c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:20.802273 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-067df7e2-6814-46f6-92ab-a8db5445670c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:20.802702 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-067df7e2-6814-46f6-92ab-a8db5445670c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:20.945969 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-067df7e2-6814-46f6-92ab-a8db5445670c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:20.953997 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-067df7e2-6814-46f6-92ab-a8db5445670c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.164499 Jul 07 15:42:20.955165 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 524/1043] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:20 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:21.275975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-dc8ddc7e-e94e-4127-ac23-3523195a1072 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:21.277386 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-dc8ddc7e-e94e-4127-ac23-3523195a1072 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:21.284685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dc8ddc7e-e94e-4127-ac23-3523195a1072 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:21.285248 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dc8ddc7e-e94e-4127-ac23-3523195a1072 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:21.286637 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dc8ddc7e-e94e-4127-ac23-3523195a1072 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:21.286786 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-dc8ddc7e-e94e-4127-ac23-3523195a1072 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:21.320669 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:21.450399 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-dc8ddc7e-e94e-4127-ac23-3523195a1072 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:21.458400 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-dc8ddc7e-e94e-4127-ac23-3523195a1072 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1504 microversion: 2.1 time: 0.186763 Jul 07 15:42:21.458971 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 520/1044] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:21 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:21.970109 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b6329561-6302-4257-b87d-81a4ce06d6c0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:21.970716 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b6329561-6302-4257-b87d-81a4ce06d6c0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:21.977837 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b6329561-6302-4257-b87d-81a4ce06d6c0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:21.978283 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b6329561-6302-4257-b87d-81a4ce06d6c0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:21.979042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b6329561-6302-4257-b87d-81a4ce06d6c0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:21.979472 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b6329561-6302-4257-b87d-81a4ce06d6c0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:21.997950 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:22.109780 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b6329561-6302-4257-b87d-81a4ce06d6c0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:22.118000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b6329561-6302-4257-b87d-81a4ce06d6c0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.151700 Jul 07 15:42:22.118563 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 525/1045] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:21 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:22.476301 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9b382486-f202-4f26-96e2-d8580d2dee44 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:22.476913 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9b382486-f202-4f26-96e2-d8580d2dee44 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:22.483312 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9b382486-f202-4f26-96e2-d8580d2dee44 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:22.483798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9b382486-f202-4f26-96e2-d8580d2dee44 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:22.484546 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9b382486-f202-4f26-96e2-d8580d2dee44 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:22.484992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9b382486-f202-4f26-96e2-d8580d2dee44 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:22.614975 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9b382486-f202-4f26-96e2-d8580d2dee44 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:22.623501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9b382486-f202-4f26-96e2-d8580d2dee44 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1504 microversion: 2.1 time: 0.151048 Jul 07 15:42:22.624092 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 521/1046] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:22 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:23.135123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e5f54da0-d71d-4e85-8d66-8f58011a6095 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:23.135754 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e5f54da0-d71d-4e85-8d66-8f58011a6095 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:23.143621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e5f54da0-d71d-4e85-8d66-8f58011a6095 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:23.144903 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e5f54da0-d71d-4e85-8d66-8f58011a6095 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:23.145676 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e5f54da0-d71d-4e85-8d66-8f58011a6095 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:23.146640 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e5f54da0-d71d-4e85-8d66-8f58011a6095 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:23.339811 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e5f54da0-d71d-4e85-8d66-8f58011a6095 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:23.347511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e5f54da0-d71d-4e85-8d66-8f58011a6095 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.216272 Jul 07 15:42:23.348346 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 526/1047] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:23 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:23.607910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-871cbcd7-28c6-4d6f-accb-e7d29372df8f req-40a09155-c52f-4747-9d6f-fc3463599d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8c6850-8369-499b-9f86-95bf45d62118", "name": "network-vif-deleted", "tag": "8bba30e1-7679-4246-b545-3dc79513c8c8"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:23.618505 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-871cbcd7-28c6-4d6f-accb-e7d29372df8f req-40a09155-c52f-4747-9d6f-fc3463599d99 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:23.618943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-871cbcd7-28c6-4d6f-accb-e7d29372df8f req-40a09155-c52f-4747-9d6f-fc3463599d99 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:23.632080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-871cbcd7-28c6-4d6f-accb-e7d29372df8f req-40a09155-c52f-4747-9d6f-fc3463599d99 service nova] Creating event network-vif-deleted:8bba30e1-7679-4246-b545-3dc79513c8c8 for instance 8f8c6850-8369-499b-9f86-95bf45d62118 on hv-cinder-84130 Jul 07 15:42:23.637598 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-871cbcd7-28c6-4d6f-accb-e7d29372df8f req-40a09155-c52f-4747-9d6f-fc3463599d99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033243 Jul 07 15:42:23.641978 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-99786a4b-31e8-4e08-9311-af73ea145dac tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:23.642876 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-99786a4b-31e8-4e08-9311-af73ea145dac tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:23.644276 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 522/1048] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:23.650180 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-99786a4b-31e8-4e08-9311-af73ea145dac tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:23.651098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-99786a4b-31e8-4e08-9311-af73ea145dac tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:23.652122 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-99786a4b-31e8-4e08-9311-af73ea145dac tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:23.652770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-99786a4b-31e8-4e08-9311-af73ea145dac tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:23.750596 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-99786a4b-31e8-4e08-9311-af73ea145dac tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:23.758319 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-99786a4b-31e8-4e08-9311-af73ea145dac tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 200 len: 1462 microversion: 2.1 time: 0.120935 Jul 07 15:42:23.758883 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 527/1049] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:23 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 1462 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:23.845599 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-1e9caacd-e7f1-4b6d-9188-6697c1899ad5 req-ce114a86-b5e4-4123-9118-70ed064b457a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66906c69-cb44-49e3-ba9b-59dffb9f6181", "tag": "03660176-9b44-4590-8337-3977dc2d927b"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:23.856899 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-1e9caacd-e7f1-4b6d-9188-6697c1899ad5 req-ce114a86-b5e4-4123-9118-70ed064b457a service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:23.857321 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-1e9caacd-e7f1-4b6d-9188-6697c1899ad5 req-ce114a86-b5e4-4123-9118-70ed064b457a service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:23.874381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-1e9caacd-e7f1-4b6d-9188-6697c1899ad5 req-ce114a86-b5e4-4123-9118-70ed064b457a service nova] Creating event network-changed:03660176-9b44-4590-8337-3977dc2d927b for instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 on hv-cinder-84130 Jul 07 15:42:23.884858 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-1e9caacd-e7f1-4b6d-9188-6697c1899ad5 req-ce114a86-b5e4-4123-9118-70ed064b457a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043207 Jul 07 15:42:23.887057 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 523/1050] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:24.366609 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-eb36474f-2af1-48ff-a410-625a0ec11208 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:24.368103 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-eb36474f-2af1-48ff-a410-625a0ec11208 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:24.378038 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eb36474f-2af1-48ff-a410-625a0ec11208 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:24.378038 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eb36474f-2af1-48ff-a410-625a0ec11208 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:24.378038 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eb36474f-2af1-48ff-a410-625a0ec11208 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:24.378038 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-eb36474f-2af1-48ff-a410-625a0ec11208 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:24.586782 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-eb36474f-2af1-48ff-a410-625a0ec11208 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:24.595167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-eb36474f-2af1-48ff-a410-625a0ec11208 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.233232 Jul 07 15:42:24.602727 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 528/1051] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:24 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:24.776193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:24.776886 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: 8f8c6850-8369-499b-9f86-95bf45d62118] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:24.783088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:24.783534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:24.784319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:24.784749 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:24.798097 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] HTTP exception thrown: Instance 8f8c6850-8369-499b-9f86-95bf45d62118 could not be found. Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Request method failure captured: Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 HTTP/1.1 Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv7CyxqjJmdcnzWIzGW0dBc5g4lbE4MHQ1oUXaDu-emPrNOumzDmHXKHc-jbW0bFjcWyrh8zL-VZQvqNPLL9vmZJDzjXiQZex33mQxChM3PBqrnIQ0pMxkexfGClSq_CfygSULQcuYORm5izik0gDrcYChBmUgGNr4zbgz0DvrMHlxk Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: f90b44820e424210b4dea0abc23ea469 Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-VolumesActionsTest-944480723 Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:42:24.799809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f90b44820e424210b4dea0abc23ea469", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f90b44820e424210b4dea0abc23ea469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90b44820e424210b4dea0abc23ea469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90b44820e424210b4dea0abc23ea469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-VolumesActionsTest-944480723 Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: f90b44820e424210b4dea0abc23ea469 Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-VolumesActionsTest-944480723 Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-VolumesActionsTest-944480723-project Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 03f8ed4d3d5a4447ba2c61b3dd4c314a Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-VolumesActionsTest-944480723-project Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 8f8c6850-8369-499b-9f86-95bf45d62118 could not be found. Jul 07 15:42:24.801507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '8f8c6850-8369-499b-9f86-95bf45d62118'} Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8c6850-8369-499b-9f86-95bf45d62118 could not be found. Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:42:24.802460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8c6850-8369-499b-9f86-95bf45d62118 could not be found. Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8c6850-8369-499b-9f86-95bf45d62118 could not be found. Jul 07 15:42:24.804520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:24.811313 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Returning 404 to user: Instance 8f8c6850-8369-499b-9f86-95bf45d62118 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:42:24.811313 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-22b88213-65cd-4c57-ab76-1b0b5e2a358e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118" status: 404 len: 111 microversion: 2.1 time: 0.029953 Jul 07 15:42:24.811313 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 524/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:24 2022] GET /compute/v2.1/servers/8f8c6850-8369-499b-9f86-95bf45d62118 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:42:24.903635 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-531843033", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "networks": [{"uuid": "9da41ecc-09e3-4587-b0bc-9b4f13d625d5"}]}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:24.954279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.network.neutron [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] validate_networks() for [('9da41ecc-09e3-4587-b0bc-9b4f13d625d5', None, None, None, None, None)] {{(pid=124719) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:42:25.291940 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Flavor limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:42:25.292397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Image limits 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:42:25.292866 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Flavor pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:42:25.293268 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Image pref 0:0:0 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:42:25.293873 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.virt.hardware [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:42:25.302952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:25.303417 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:25.304279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:25.304708 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:25.321847 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Getting quotas for project f90b44820e424210b4dea0abc23ea469. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:42:25.325755 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.quota [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Getting quotas for user 03f8ed4d3d5a4447ba2c61b3dd4c314a and project f90b44820e424210b4dea0abc23ea469. Resources: {'instances', 'cores', 'ram'} {{(pid=124719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:42:25.337008 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Going to run 1 instances... {{(pid=124719) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:42:25.339277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:42:25.525120 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cddca0a5-fe27-4c68-bad9-d1ce6fb05218 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625452 Jul 07 15:42:25.525912 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 529/1053] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:42:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:42:25.535455 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-b1d1a6a9-5e26-4327-80c3-eceb046257ff tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:25.536085 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-b1d1a6a9-5e26-4327-80c3-eceb046257ff tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:25.590273 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-b1d1a6a9-5e26-4327-80c3-eceb046257ff tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:25.596724 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-b1d1a6a9-5e26-4327-80c3-eceb046257ff tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1213 microversion: 2.1 time: 0.065030 Jul 07 15:42:25.597286 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 525/1054] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:25 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:25.611766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f0815c4b-308f-4491-baf9-aa09a52ad04b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:25.612368 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f0815c4b-308f-4491-baf9-aa09a52ad04b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:25.620850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f0815c4b-308f-4491-baf9-aa09a52ad04b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:25.620850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f0815c4b-308f-4491-baf9-aa09a52ad04b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:25.620850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f0815c4b-308f-4491-baf9-aa09a52ad04b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:25.621517 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f0815c4b-308f-4491-baf9-aa09a52ad04b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:25.755796 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f0815c4b-308f-4491-baf9-aa09a52ad04b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:25.763899 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f0815c4b-308f-4491-baf9-aa09a52ad04b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.155768 Jul 07 15:42:25.764465 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 530/1055] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:25 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:26.613878 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a542d319-bcd8-44e2-91bf-7c3f6b0cb49c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:26.614463 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a542d319-bcd8-44e2-91bf-7c3f6b0cb49c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:26.670215 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a542d319-bcd8-44e2-91bf-7c3f6b0cb49c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:26.676890 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a542d319-bcd8-44e2-91bf-7c3f6b0cb49c tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1213 microversion: 2.1 time: 0.067378 Jul 07 15:42:26.677450 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 526/1056] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:26 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:26.781779 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-9a9b408e-7bba-4d7d-bc7e-68396dab5924 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:26.782403 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-9a9b408e-7bba-4d7d-bc7e-68396dab5924 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:26.789079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9a9b408e-7bba-4d7d-bc7e-68396dab5924 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:26.789533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9a9b408e-7bba-4d7d-bc7e-68396dab5924 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:26.790301 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9a9b408e-7bba-4d7d-bc7e-68396dab5924 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:26.790739 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-9a9b408e-7bba-4d7d-bc7e-68396dab5924 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:26.924323 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-9a9b408e-7bba-4d7d-bc7e-68396dab5924 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:26.947025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-9a9b408e-7bba-4d7d-bc7e-68396dab5924 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.169078 Jul 07 15:42:26.947850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 531/1057] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:26 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:27.627407 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1790431862", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-92263573", "security_groups": [{"name": "tempest-secgroup-smoke-1899091157"}], "block_device_mapping_v2": [{"uuid": "f6ff6da9-00d7-41b5-9361-6da9dc950bf0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29820a51-47ed-4a8e-8170-71221aa2cdfe"}]}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:27.693720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-cf3a93ef-8aba-4100-9379-4fc5d1fbb701 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:27.694597 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-cf3a93ef-8aba-4100-9379-4fc5d1fbb701 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:27.701011 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf3a93ef-8aba-4100-9379-4fc5d1fbb701 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:27.701458 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf3a93ef-8aba-4100-9379-4fc5d1fbb701 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:27.702400 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf3a93ef-8aba-4100-9379-4fc5d1fbb701 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:27.703000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-cf3a93ef-8aba-4100-9379-4fc5d1fbb701 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:27.748513 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] validate_networks() for [('29820a51-47ed-4a8e-8170-71221aa2cdfe', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:42:27.798937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-cf3a93ef-8aba-4100-9379-4fc5d1fbb701 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:27.806359 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-cf3a93ef-8aba-4100-9379-4fc5d1fbb701 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1265 microversion: 2.1 time: 0.116567 Jul 07 15:42:27.815738 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 532/1058] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:27 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:27.964207 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-886bdec9-4c69-4215-8000-89a3ae564c48 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:27.964817 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-886bdec9-4c69-4215-8000-89a3ae564c48 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:27.970926 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-886bdec9-4c69-4215-8000-89a3ae564c48 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:27.971375 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-886bdec9-4c69-4215-8000-89a3ae564c48 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:27.972174 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-886bdec9-4c69-4215-8000-89a3ae564c48 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:27.972602 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-886bdec9-4c69-4215-8000-89a3ae564c48 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:28.551123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-886bdec9-4c69-4215-8000-89a3ae564c48 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:28.558444 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-886bdec9-4c69-4215-8000-89a3ae564c48 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.598649 Jul 07 15:42:28.559011 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 533/1059] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:27 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:28.622865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:42:28.623362 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:42:28.624056 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:42:28.624563 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:42:28.625442 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:42:28.638623 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:28.639249 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:28.639914 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:28.640401 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:28.666055 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Getting quotas for project b72dae7a2e644460b4c63da884023c82. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:42:28.670895 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Getting quotas for user 05e0f1ddeb224677b18cfc769dc45d47 and project b72dae7a2e644460b4c63da884023c82. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:42:28.729810 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:42:28.731931 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6ff6da9-00d7-41b5-9361-6da9dc950bf0',volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:42:28.823472 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e4734023-6cfe-40a3-a4cc-c8fb4acfb8ef tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:28.824265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e4734023-6cfe-40a3-a4cc-c8fb4acfb8ef tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:28.831163 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4734023-6cfe-40a3-a4cc-c8fb4acfb8ef tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:28.831687 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4734023-6cfe-40a3-a4cc-c8fb4acfb8ef tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:28.832613 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4734023-6cfe-40a3-a4cc-c8fb4acfb8ef tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:28.833039 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e4734023-6cfe-40a3-a4cc-c8fb4acfb8ef tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:28.907847 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e4734023-6cfe-40a3-a4cc-c8fb4acfb8ef tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:28.916056 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e4734023-6cfe-40a3-a4cc-c8fb4acfb8ef tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1271 microversion: 2.1 time: 0.097171 Jul 07 15:42:28.916633 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 534/1060] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:28 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:29.013698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-df3d946c-4c8c-4331-a07a-a95425ae26df req-ee5383f6-4f57-4d86-9916-5aace46f68ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66906c69-cb44-49e3-ba9b-59dffb9f6181", "name": "network-vif-plugged", "status": "completed", "tag": "03660176-9b44-4590-8337-3977dc2d927b"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:29.024817 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-df3d946c-4c8c-4331-a07a-a95425ae26df req-ee5383f6-4f57-4d86-9916-5aace46f68ce service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:29.025255 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-df3d946c-4c8c-4331-a07a-a95425ae26df req-ee5383f6-4f57-4d86-9916-5aace46f68ce service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:29.036473 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-df3d946c-4c8c-4331-a07a-a95425ae26df req-ee5383f6-4f57-4d86-9916-5aace46f68ce service nova] Creating event network-vif-plugged:03660176-9b44-4590-8337-3977dc2d927b for instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 on hv-cinder-84130 Jul 07 15:42:29.041744 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-df3d946c-4c8c-4331-a07a-a95425ae26df req-ee5383f6-4f57-4d86-9916-5aace46f68ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031745 Jul 07 15:42:29.042338 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 535/1061] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:29.240068 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d57519b8-61f9-456b-820d-179eedf1c664 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.616638 Jul 07 15:42:29.241396 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 527/1062] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:42:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:42:29.255251 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5bd9f495-c7a2-4373-a639-bd7558ea46c8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:29.256391 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5bd9f495-c7a2-4373-a639-bd7558ea46c8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:29.344387 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5bd9f495-c7a2-4373-a639-bd7558ea46c8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:29.352113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5bd9f495-c7a2-4373-a639-bd7558ea46c8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1093 microversion: 2.1 time: 0.103003 Jul 07 15:42:29.352684 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 536/1063] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:29 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1093 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:29.575658 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7b922253-133d-4fff-a88c-46b9c68c6a32 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:29.576302 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7b922253-133d-4fff-a88c-46b9c68c6a32 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:29.583316 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b922253-133d-4fff-a88c-46b9c68c6a32 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:29.585084 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b922253-133d-4fff-a88c-46b9c68c6a32 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:29.585939 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b922253-133d-4fff-a88c-46b9c68c6a32 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:29.586382 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7b922253-133d-4fff-a88c-46b9c68c6a32 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:29.799087 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7b922253-133d-4fff-a88c-46b9c68c6a32 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:29.808070 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7b922253-133d-4fff-a88c-46b9c68c6a32 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.236450 Jul 07 15:42:29.808638 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 528/1064] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:29 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:29.933986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c1f5b4f8-0e3c-4d4c-85b5-814c74cd0e25 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:29.934557 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c1f5b4f8-0e3c-4d4c-85b5-814c74cd0e25 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:29.941686 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c1f5b4f8-0e3c-4d4c-85b5-814c74cd0e25 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:29.942136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c1f5b4f8-0e3c-4d4c-85b5-814c74cd0e25 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:29.942901 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c1f5b4f8-0e3c-4d4c-85b5-814c74cd0e25 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:29.943340 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c1f5b4f8-0e3c-4d4c-85b5-814c74cd0e25 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:30.152113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c1f5b4f8-0e3c-4d4c-85b5-814c74cd0e25 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:30.159554 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c1f5b4f8-0e3c-4d4c-85b5-814c74cd0e25 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1313 microversion: 2.1 time: 0.229537 Jul 07 15:42:30.169067 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 537/1065] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:29 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:30.370462 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-df659834-91c1-43a8-a6d3-59ee767b079f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:30.371048 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-df659834-91c1-43a8-a6d3-59ee767b079f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:30.382416 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-85779cde-7bfe-48d0-ad17-be16b5c3d2d2 req-ba39023f-160d-4e5b-b411-319a01a747b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab219d06-7e13-4675-9711-a8752c3db63a", "tag": "9065951b-c1d0-4227-81f8-045652074fe4"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:30.385381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-df659834-91c1-43a8-a6d3-59ee767b079f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:30.385381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-df659834-91c1-43a8-a6d3-59ee767b079f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:30.385381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-df659834-91c1-43a8-a6d3-59ee767b079f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:30.385381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-df659834-91c1-43a8-a6d3-59ee767b079f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:30.393488 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:30.400880 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-85779cde-7bfe-48d0-ad17-be16b5c3d2d2 req-ba39023f-160d-4e5b-b411-319a01a747b3 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:30.401743 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-85779cde-7bfe-48d0-ad17-be16b5c3d2d2 req-ba39023f-160d-4e5b-b411-319a01a747b3 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:30.413358 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-85779cde-7bfe-48d0-ad17-be16b5c3d2d2 req-ba39023f-160d-4e5b-b411-319a01a747b3 service nova] Creating event network-changed:9065951b-c1d0-4227-81f8-045652074fe4 for instance ab219d06-7e13-4675-9711-a8752c3db63a on hv-cinder-84130 Jul 07 15:42:30.418191 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-85779cde-7bfe-48d0-ad17-be16b5c3d2d2 req-ba39023f-160d-4e5b-b411-319a01a747b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040184 Jul 07 15:42:30.418870 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 538/1066] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:30.459762 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-df659834-91c1-43a8-a6d3-59ee767b079f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:30.467867 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-df659834-91c1-43a8-a6d3-59ee767b079f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1143 microversion: 2.1 time: 0.101770 Jul 07 15:42:30.468447 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 529/1067] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:30 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1143 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:30.826452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-20a86f6a-2230-491a-b870-d73f424d28b1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:30.827069 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-20a86f6a-2230-491a-b870-d73f424d28b1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:30.833410 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-20a86f6a-2230-491a-b870-d73f424d28b1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:30.833856 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-20a86f6a-2230-491a-b870-d73f424d28b1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:30.834629 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-20a86f6a-2230-491a-b870-d73f424d28b1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:30.835055 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-20a86f6a-2230-491a-b870-d73f424d28b1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:30.975056 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-20a86f6a-2230-491a-b870-d73f424d28b1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:30.983816 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-20a86f6a-2230-491a-b870-d73f424d28b1 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1358 microversion: 2.1 time: 0.161883 Jul 07 15:42:30.984396 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 539/1068] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:30 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:31.176788 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d0371bc2-3799-4c15-9d76-f20f15b9d926 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:31.177406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d0371bc2-3799-4c15-9d76-f20f15b9d926 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:31.184685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0371bc2-3799-4c15-9d76-f20f15b9d926 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:31.184685 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0371bc2-3799-4c15-9d76-f20f15b9d926 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:31.185482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0371bc2-3799-4c15-9d76-f20f15b9d926 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:31.185947 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d0371bc2-3799-4c15-9d76-f20f15b9d926 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:31.367441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d0371bc2-3799-4c15-9d76-f20f15b9d926 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:31.374761 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d0371bc2-3799-4c15-9d76-f20f15b9d926 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1313 microversion: 2.1 time: 0.201868 Jul 07 15:42:31.375328 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 530/1069] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:31 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:31.485601 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-e8a9bfdc-4438-4ed2-af83-3942562fe842 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:31.486132 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-e8a9bfdc-4438-4ed2-af83-3942562fe842 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:31.492353 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e8a9bfdc-4438-4ed2-af83-3942562fe842 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:31.492788 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e8a9bfdc-4438-4ed2-af83-3942562fe842 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:31.493530 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e8a9bfdc-4438-4ed2-af83-3942562fe842 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:31.493955 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-e8a9bfdc-4438-4ed2-af83-3942562fe842 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:31.581397 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-e8a9bfdc-4438-4ed2-af83-3942562fe842 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:31.590005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-e8a9bfdc-4438-4ed2-af83-3942562fe842 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1191 microversion: 2.1 time: 0.108211 Jul 07 15:42:31.590580 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 540/1070] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:31 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1191 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:32.002661 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-86c37fbd-50b8-417c-a2aa-65a5e6e6f604 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:32.003427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-86c37fbd-50b8-417c-a2aa-65a5e6e6f604 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:32.010551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-86c37fbd-50b8-417c-a2aa-65a5e6e6f604 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.011479 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-86c37fbd-50b8-417c-a2aa-65a5e6e6f604 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.012288 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-86c37fbd-50b8-417c-a2aa-65a5e6e6f604 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.012728 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-86c37fbd-50b8-417c-a2aa-65a5e6e6f604 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.144763 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-86c37fbd-50b8-417c-a2aa-65a5e6e6f604 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:32.152424 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-86c37fbd-50b8-417c-a2aa-65a5e6e6f604 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1548 microversion: 2.1 time: 0.154561 Jul 07 15:42:32.153004 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 531/1071] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:31 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:32.168621 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4cc9ee21-f4da-48d5-9f90-3d4b9d5433e8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:32.169313 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4cc9ee21-f4da-48d5-9f90-3d4b9d5433e8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:32.175799 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4cc9ee21-f4da-48d5-9f90-3d4b9d5433e8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.176248 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4cc9ee21-f4da-48d5-9f90-3d4b9d5433e8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.177014 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4cc9ee21-f4da-48d5-9f90-3d4b9d5433e8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.177441 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4cc9ee21-f4da-48d5-9f90-3d4b9d5433e8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.307966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4cc9ee21-f4da-48d5-9f90-3d4b9d5433e8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:32.315600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4cc9ee21-f4da-48d5-9f90-3d4b9d5433e8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1548 microversion: 2.1 time: 0.150791 Jul 07 15:42:32.316150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 541/1072] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:32 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:32.334907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-1f8533d2-37f0-479a-897e-11437b6c4590 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:32.335618 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-1f8533d2-37f0-479a-897e-11437b6c4590 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:32.336442 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-1f8533d2-37f0-479a-897e-11437b6c4590 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Searching by: {'deleted': False, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f'} {{(pid=124720) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 07 15:42:32.343365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1f8533d2-37f0-479a-897e-11437b6c4590 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.343923 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1f8533d2-37f0-479a-897e-11437b6c4590 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.344714 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1f8533d2-37f0-479a-897e-11437b6c4590 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.345139 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-1f8533d2-37f0-479a-897e-11437b6c4590 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.391292 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8d0d7aef-9826-4533-90e7-57979991bea8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:32.391921 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8d0d7aef-9826-4533-90e7-57979991bea8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:32.398634 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8d0d7aef-9826-4533-90e7-57979991bea8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.399078 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8d0d7aef-9826-4533-90e7-57979991bea8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.399858 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8d0d7aef-9826-4533-90e7-57979991bea8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.400464 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8d0d7aef-9826-4533-90e7-57979991bea8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.438955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.multi_cell_list [None req-1f8533d2-37f0-479a-897e-11437b6c4590 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 07 15:42:32.541973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-1f8533d2-37f0-479a-897e-11437b6c4590 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213717 Jul 07 15:42:32.542648 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 532/1073] 10.222.0.25 () {58 vars in 1124 bytes} [Thu Jul 7 15:42:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:32.550009 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8d0d7aef-9826-4533-90e7-57979991bea8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:32.558636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-74b60a42-c391-426d-8f53-1330cbe4cb7b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:32.558636 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-74b60a42-c391-426d-8f53-1330cbe4cb7b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:32.559947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8d0d7aef-9826-4533-90e7-57979991bea8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1313 microversion: 2.1 time: 0.172324 Jul 07 15:42:32.561541 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 542/1074] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:32 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:32.563051 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-74b60a42-c391-426d-8f53-1330cbe4cb7b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.563737 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-74b60a42-c391-426d-8f53-1330cbe4cb7b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.564718 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-74b60a42-c391-426d-8f53-1330cbe4cb7b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.565157 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-74b60a42-c391-426d-8f53-1330cbe4cb7b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.606725 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-939c9e7f-5afb-4335-a2cc-bf1be8fa50f5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:32.607332 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-939c9e7f-5afb-4335-a2cc-bf1be8fa50f5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:32.614081 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-939c9e7f-5afb-4335-a2cc-bf1be8fa50f5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.614535 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-939c9e7f-5afb-4335-a2cc-bf1be8fa50f5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.615303 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-939c9e7f-5afb-4335-a2cc-bf1be8fa50f5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:32.615869 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-939c9e7f-5afb-4335-a2cc-bf1be8fa50f5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:32.753726 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-74b60a42-c391-426d-8f53-1330cbe4cb7b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:32.761228 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-74b60a42-c391-426d-8f53-1330cbe4cb7b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1548 microversion: 2.1 time: 0.212100 Jul 07 15:42:32.761802 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 533/1075] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:32 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1548 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:32.830790 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-939c9e7f-5afb-4335-a2cc-bf1be8fa50f5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:32.843129 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-939c9e7f-5afb-4335-a2cc-bf1be8fa50f5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1277 microversion: 2.1 time: 0.240062 Jul 07 15:42:32.845216 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 543/1076] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:32 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:33.567036 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-428a1aa6-5a05-461a-87a7-15a77aacae74 req-91d3e56f-58a2-487e-9300-fd3ad859b713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1cc41e-3a12-4fdc-9cec-0cf589c82e21", "tag": "5aa4d37a-551d-4dfc-a30c-bbdfea38d06a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:33.577005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-38a51613-0a75-4ed1-aab0-b283f961532f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:33.577623 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-38a51613-0a75-4ed1-aab0-b283f961532f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:33.577798 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-428a1aa6-5a05-461a-87a7-15a77aacae74 req-91d3e56f-58a2-487e-9300-fd3ad859b713 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:33.578127 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-428a1aa6-5a05-461a-87a7-15a77aacae74 req-91d3e56f-58a2-487e-9300-fd3ad859b713 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:33.589135 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-38a51613-0a75-4ed1-aab0-b283f961532f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:33.589814 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-38a51613-0a75-4ed1-aab0-b283f961532f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:33.590772 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-38a51613-0a75-4ed1-aab0-b283f961532f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:33.591457 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-38a51613-0a75-4ed1-aab0-b283f961532f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:33.595537 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-428a1aa6-5a05-461a-87a7-15a77aacae74 req-91d3e56f-58a2-487e-9300-fd3ad859b713 service nova] Creating event network-changed:5aa4d37a-551d-4dfc-a30c-bbdfea38d06a for instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 on hv-cinder-84130 Jul 07 15:42:33.599853 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-428a1aa6-5a05-461a-87a7-15a77aacae74 req-91d3e56f-58a2-487e-9300-fd3ad859b713 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039303 Jul 07 15:42:33.600456 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 534/1077] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:33.747648 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-38a51613-0a75-4ed1-aab0-b283f961532f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:33.758277 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-38a51613-0a75-4ed1-aab0-b283f961532f tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1313 microversion: 2.1 time: 0.184553 Jul 07 15:42:33.758864 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 544/1078] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:33 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:33.863464 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-544f5531-89c4-42e8-8d1b-27effd143a5d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:33.864239 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-544f5531-89c4-42e8-8d1b-27effd143a5d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:33.871342 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-544f5531-89c4-42e8-8d1b-27effd143a5d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:33.871905 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-544f5531-89c4-42e8-8d1b-27effd143a5d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:33.872763 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-544f5531-89c4-42e8-8d1b-27effd143a5d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:33.873321 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-544f5531-89c4-42e8-8d1b-27effd143a5d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:34.022733 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-544f5531-89c4-42e8-8d1b-27effd143a5d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:34.030838 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-544f5531-89c4-42e8-8d1b-27effd143a5d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1277 microversion: 2.1 time: 0.172037 Jul 07 15:42:34.031444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 535/1079] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:33 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:34.650140 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bd69909a-ac3d-4e5d-8af2-fd5735962bd8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0a14d87-df28-40fd-bf56-bb3167999ba0"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:34.651253 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bd69909a-ac3d-4e5d-8af2-fd5735962bd8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:34.657769 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bd69909a-ac3d-4e5d-8af2-fd5735962bd8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:34.658214 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bd69909a-ac3d-4e5d-8af2-fd5735962bd8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:34.658977 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bd69909a-ac3d-4e5d-8af2-fd5735962bd8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:34.659407 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bd69909a-ac3d-4e5d-8af2-fd5735962bd8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:34.663083 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=100 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:34.775435 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e8e6b42f-5422-47a8-8a90-4693cf41b9af tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:34.779387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e8e6b42f-5422-47a8-8a90-4693cf41b9af tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:34.783160 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e8e6b42f-5422-47a8-8a90-4693cf41b9af tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:34.783638 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e8e6b42f-5422-47a8-8a90-4693cf41b9af tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:34.784411 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e8e6b42f-5422-47a8-8a90-4693cf41b9af tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:34.784847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e8e6b42f-5422-47a8-8a90-4693cf41b9af tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:34.921754 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e8e6b42f-5422-47a8-8a90-4693cf41b9af tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:34.939152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e8e6b42f-5422-47a8-8a90-4693cf41b9af tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1313 microversion: 2.1 time: 0.167558 Jul 07 15:42:34.939759 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 536/1080] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:34 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:35.048561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-524037ab-e614-456e-8624-18166844c027 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:35.049245 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-524037ab-e614-456e-8624-18166844c027 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:35.055303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-524037ab-e614-456e-8624-18166844c027 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:35.055788 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-524037ab-e614-456e-8624-18166844c027 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:35.056560 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-524037ab-e614-456e-8624-18166844c027 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:35.056993 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-524037ab-e614-456e-8624-18166844c027 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:35.189887 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-524037ab-e614-456e-8624-18166844c027 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:35.197460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-524037ab-e614-456e-8624-18166844c027 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.152812 Jul 07 15:42:35.198021 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 537/1081] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:35 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:35.313246 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:35.368113 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bd69909a-ac3d-4e5d-8af2-fd5735962bd8 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "POST /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721181 Jul 07 15:42:35.368765 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 545/1082] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:42:34 2022] POST /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:35.955917 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e09d0844-0621-4317-b411-c11389defa41 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:35.956522 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e09d0844-0621-4317-b411-c11389defa41 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:35.963505 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e09d0844-0621-4317-b411-c11389defa41 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:35.963992 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e09d0844-0621-4317-b411-c11389defa41 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:35.964752 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e09d0844-0621-4317-b411-c11389defa41 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:35.965185 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e09d0844-0621-4317-b411-c11389defa41 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:36.102613 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e09d0844-0621-4317-b411-c11389defa41 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:36.109955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e09d0844-0621-4317-b411-c11389defa41 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1313 microversion: 2.1 time: 0.157977 Jul 07 15:42:36.110520 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 538/1083] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:35 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:36.215945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8a9b4bbb-ad2f-487b-810f-0eb7e8f9fa09 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:36.216576 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8a9b4bbb-ad2f-487b-810f-0eb7e8f9fa09 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:36.223126 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8a9b4bbb-ad2f-487b-810f-0eb7e8f9fa09 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:36.223605 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8a9b4bbb-ad2f-487b-810f-0eb7e8f9fa09 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:36.224374 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8a9b4bbb-ad2f-487b-810f-0eb7e8f9fa09 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:36.224810 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8a9b4bbb-ad2f-487b-810f-0eb7e8f9fa09 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:36.364127 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8a9b4bbb-ad2f-487b-810f-0eb7e8f9fa09 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:36.373590 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8a9b4bbb-ad2f-487b-810f-0eb7e8f9fa09 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.163101 Jul 07 15:42:36.374676 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 546/1084] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:36 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:36.998949 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-21370206-201d-4572-bd0b-3b56b7c2504e req-2cfb5247-5fdd-4675-9525-ee0a5ea5ce12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab219d06-7e13-4675-9711-a8752c3db63a", "name": "network-vif-plugged", "status": "completed", "tag": "9065951b-c1d0-4227-81f8-045652074fe4"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:37.008979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-21370206-201d-4572-bd0b-3b56b7c2504e req-2cfb5247-5fdd-4675-9525-ee0a5ea5ce12 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:37.009416 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-21370206-201d-4572-bd0b-3b56b7c2504e req-2cfb5247-5fdd-4675-9525-ee0a5ea5ce12 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:37.025197 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-21370206-201d-4572-bd0b-3b56b7c2504e req-2cfb5247-5fdd-4675-9525-ee0a5ea5ce12 service nova] Creating event network-vif-plugged:9065951b-c1d0-4227-81f8-045652074fe4 for instance ab219d06-7e13-4675-9711-a8752c3db63a on hv-cinder-84130 Jul 07 15:42:37.031192 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-21370206-201d-4572-bd0b-3b56b7c2504e req-2cfb5247-5fdd-4675-9525-ee0a5ea5ce12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036271 Jul 07 15:42:37.031909 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 539/1085] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:37.126308 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fcbb761e-142b-4289-a2be-6aced744a9e8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:37.126950 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fcbb761e-142b-4289-a2be-6aced744a9e8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:37.133637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcbb761e-142b-4289-a2be-6aced744a9e8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:37.134084 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcbb761e-142b-4289-a2be-6aced744a9e8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:37.136011 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcbb761e-142b-4289-a2be-6aced744a9e8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:37.136011 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fcbb761e-142b-4289-a2be-6aced744a9e8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:37.265223 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-fcbb761e-142b-4289-a2be-6aced744a9e8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:37.272693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fcbb761e-142b-4289-a2be-6aced744a9e8 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1313 microversion: 2.1 time: 0.150312 Jul 07 15:42:37.273251 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 547/1086] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:37 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:37.391088 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e1ce43ec-131d-46a0-9447-9b1194ce9cf5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:37.391809 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e1ce43ec-131d-46a0-9447-9b1194ce9cf5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:37.398046 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e1ce43ec-131d-46a0-9447-9b1194ce9cf5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:37.398486 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e1ce43ec-131d-46a0-9447-9b1194ce9cf5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:37.399231 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e1ce43ec-131d-46a0-9447-9b1194ce9cf5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:37.399686 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e1ce43ec-131d-46a0-9447-9b1194ce9cf5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:37.532233 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e1ce43ec-131d-46a0-9447-9b1194ce9cf5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:37.539613 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e1ce43ec-131d-46a0-9447-9b1194ce9cf5 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.152691 Jul 07 15:42:37.540172 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 540/1087] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:37 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:38.290402 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-bf7a602b-7d86-492b-b812-1bd5a23d9150 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:38.290945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-bf7a602b-7d86-492b-b812-1bd5a23d9150 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:38.297340 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bf7a602b-7d86-492b-b812-1bd5a23d9150 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:38.297777 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bf7a602b-7d86-492b-b812-1bd5a23d9150 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:38.298520 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bf7a602b-7d86-492b-b812-1bd5a23d9150 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:38.298945 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-bf7a602b-7d86-492b-b812-1bd5a23d9150 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:38.425106 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-bf7a602b-7d86-492b-b812-1bd5a23d9150 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:38.432551 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-bf7a602b-7d86-492b-b812-1bd5a23d9150 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1313 microversion: 2.1 time: 0.146793 Jul 07 15:42:38.433120 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 548/1088] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:38 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:38.556467 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-76f9ba00-0884-4602-bcc5-e499a0258ff6 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:38.557096 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-76f9ba00-0884-4602-bcc5-e499a0258ff6 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:38.563473 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76f9ba00-0884-4602-bcc5-e499a0258ff6 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:38.563960 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76f9ba00-0884-4602-bcc5-e499a0258ff6 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:38.564718 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76f9ba00-0884-4602-bcc5-e499a0258ff6 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:38.565160 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-76f9ba00-0884-4602-bcc5-e499a0258ff6 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:38.677441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=10 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:38.698278 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-76f9ba00-0884-4602-bcc5-e499a0258ff6 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:38.705689 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-76f9ba00-0884-4602-bcc5-e499a0258ff6 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.153253 Jul 07 15:42:38.711416 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 541/1089] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:38 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:39.450076 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b7ac395d-159d-46ff-9fc5-cb515b0fcb54 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:39.450673 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b7ac395d-159d-46ff-9fc5-cb515b0fcb54 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:39.453087 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=8 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:39.457850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b7ac395d-159d-46ff-9fc5-cb515b0fcb54 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:39.458292 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b7ac395d-159d-46ff-9fc5-cb515b0fcb54 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:39.459035 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b7ac395d-159d-46ff-9fc5-cb515b0fcb54 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:39.459457 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b7ac395d-159d-46ff-9fc5-cb515b0fcb54 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:39.591502 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b7ac395d-159d-46ff-9fc5-cb515b0fcb54 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:39.599149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b7ac395d-159d-46ff-9fc5-cb515b0fcb54 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1497 microversion: 2.1 time: 0.153181 Jul 07 15:42:39.599743 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 549/1090] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:39 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:39.723744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-09abb7f3-33d2-4305-98b4-88838b26f2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:39.724352 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-09abb7f3-33d2-4305-98b4-88838b26f2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:39.730891 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-09abb7f3-33d2-4305-98b4-88838b26f2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:39.731341 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-09abb7f3-33d2-4305-98b4-88838b26f2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:39.732173 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-09abb7f3-33d2-4305-98b4-88838b26f2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:39.732607 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-09abb7f3-33d2-4305-98b4-88838b26f2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:39.865664 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-09abb7f3-33d2-4305-98b4-88838b26f2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:39.869647 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=100 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:39.874101 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-09abb7f3-33d2-4305-98b4-88838b26f2c9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.154615 Jul 07 15:42:39.874710 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 542/1091] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:39 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:40.336898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-2cc1ff91-cf41-4c4e-bcfa-9e220785d625 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:40.337387 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2cc1ff91-cf41-4c4e-bcfa-9e220785d625 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:40.343498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2cc1ff91-cf41-4c4e-bcfa-9e220785d625 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:40.343976 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2cc1ff91-cf41-4c4e-bcfa-9e220785d625 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:40.344737 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2cc1ff91-cf41-4c4e-bcfa-9e220785d625 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:40.345170 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-2cc1ff91-cf41-4c4e-bcfa-9e220785d625 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:40.516432 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-2cc1ff91-cf41-4c4e-bcfa-9e220785d625 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:42:40.739838 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-2cc1ff91-cf41-4c4e-bcfa-9e220785d625 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 204 len: 0 microversion: 2.1 time: 0.407093 Jul 07 15:42:40.740418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 550/1092] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:42:40 2022] DELETE /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:42:40.749263 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-bf72d571-79db-4ec2-8cb7-7d3f42fc513e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:40.749913 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-bf72d571-79db-4ec2-8cb7-7d3f42fc513e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:40.757007 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf72d571-79db-4ec2-8cb7-7d3f42fc513e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:40.758030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf72d571-79db-4ec2-8cb7-7d3f42fc513e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:40.758777 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf72d571-79db-4ec2-8cb7-7d3f42fc513e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:40.759206 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-bf72d571-79db-4ec2-8cb7-7d3f42fc513e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:40.887721 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-bf72d571-79db-4ec2-8cb7-7d3f42fc513e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:40.890627 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fec17ec5-c864-4c9f-97e1-2ec34ba29444 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:40.891342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fec17ec5-c864-4c9f-97e1-2ec34ba29444 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:40.895392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-bf72d571-79db-4ec2-8cb7-7d3f42fc513e tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1503 microversion: 2.1 time: 0.150798 Jul 07 15:42:40.896406 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 543/1093] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:40 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:40.898723 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fec17ec5-c864-4c9f-97e1-2ec34ba29444 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:40.899195 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fec17ec5-c864-4c9f-97e1-2ec34ba29444 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:40.899993 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fec17ec5-c864-4c9f-97e1-2ec34ba29444 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:40.900419 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fec17ec5-c864-4c9f-97e1-2ec34ba29444 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:41.030149 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-fec17ec5-c864-4c9f-97e1-2ec34ba29444 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:41.037955 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fec17ec5-c864-4c9f-97e1-2ec34ba29444 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.151438 Jul 07 15:42:41.038508 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 551/1094] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:40 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:41.912954 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d1ee45c7-a3f7-4de8-9eef-c7e001ea30ed tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:41.914170 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d1ee45c7-a3f7-4de8-9eef-c7e001ea30ed tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:41.920619 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1ee45c7-a3f7-4de8-9eef-c7e001ea30ed tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:41.921067 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1ee45c7-a3f7-4de8-9eef-c7e001ea30ed tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:41.921817 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1ee45c7-a3f7-4de8-9eef-c7e001ea30ed tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:41.922254 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d1ee45c7-a3f7-4de8-9eef-c7e001ea30ed tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:42.051074 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d1ee45c7-a3f7-4de8-9eef-c7e001ea30ed tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:42.054728 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7f000aa9-c0db-4060-9c03-31c09dce2375 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:42.055338 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7f000aa9-c0db-4060-9c03-31c09dce2375 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:42.058946 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d1ee45c7-a3f7-4de8-9eef-c7e001ea30ed tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1503 microversion: 2.1 time: 0.149400 Jul 07 15:42:42.059524 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 544/1095] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:41 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:42.062043 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7f000aa9-c0db-4060-9c03-31c09dce2375 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:42.062494 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7f000aa9-c0db-4060-9c03-31c09dce2375 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:42.063265 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7f000aa9-c0db-4060-9c03-31c09dce2375 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:42.063724 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7f000aa9-c0db-4060-9c03-31c09dce2375 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:42.191101 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7f000aa9-c0db-4060-9c03-31c09dce2375 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:42.199152 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7f000aa9-c0db-4060-9c03-31c09dce2375 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.148322 Jul 07 15:42:42.199734 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 552/1096] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:42 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:42.921022 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-97c19e05-4518-4a5e-85ed-543be49eb73f req-4f78afd9-55e8-46b6-8493-a006b403e19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab219d06-7e13-4675-9711-a8752c3db63a", "name": "network-vif-deleted", "tag": "9065951b-c1d0-4227-81f8-045652074fe4"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:42.925605 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=4 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:42.930793 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-97c19e05-4518-4a5e-85ed-543be49eb73f req-4f78afd9-55e8-46b6-8493-a006b403e19d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:42.932533 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-97c19e05-4518-4a5e-85ed-543be49eb73f req-4f78afd9-55e8-46b6-8493-a006b403e19d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:42.950820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-97c19e05-4518-4a5e-85ed-543be49eb73f req-4f78afd9-55e8-46b6-8493-a006b403e19d service nova] Creating event network-vif-deleted:9065951b-c1d0-4227-81f8-045652074fe4 for instance ab219d06-7e13-4675-9711-a8752c3db63a on hv-cinder-84130 Jul 07 15:42:42.960858 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-97c19e05-4518-4a5e-85ed-543be49eb73f req-4f78afd9-55e8-46b6-8493-a006b403e19d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043450 Jul 07 15:42:42.977412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 545/1097] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:43.075898 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-5d91995b-015e-47e3-a03e-17089a123860 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:43.076537 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-5d91995b-015e-47e3-a03e-17089a123860 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:43.082874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5d91995b-015e-47e3-a03e-17089a123860 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:43.083317 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5d91995b-015e-47e3-a03e-17089a123860 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:43.084102 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5d91995b-015e-47e3-a03e-17089a123860 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:43.084533 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-5d91995b-015e-47e3-a03e-17089a123860 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:43.145782 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-5d91995b-015e-47e3-a03e-17089a123860 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f8ed4d3d5a4447ba2c61b3dd4c314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90b44820e424210b4dea0abc23ea469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:43.153317 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-5d91995b-015e-47e3-a03e-17089a123860 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 200 len: 1461 microversion: 2.1 time: 0.081247 Jul 07 15:42:43.153874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 553/1098] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:43 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 1461 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:43.216977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-8f13badd-151c-4644-b50f-c881eead2b6e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:43.217716 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-8f13badd-151c-4644-b50f-c881eead2b6e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:43.219578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:43.225288 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f13badd-151c-4644-b50f-c881eead2b6e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:43.225763 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f13badd-151c-4644-b50f-c881eead2b6e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:43.227134 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f13badd-151c-4644-b50f-c881eead2b6e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:43.227554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-8f13badd-151c-4644-b50f-c881eead2b6e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:43.366333 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-8f13badd-151c-4644-b50f-c881eead2b6e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:43.373774 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-8f13badd-151c-4644-b50f-c881eead2b6e tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.161347 Jul 07 15:42:43.374335 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 546/1099] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:43 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:43.959861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-fda235d5-a0ee-4653-af55-099c3d8ca0c9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:43.961046 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-fda235d5-a0ee-4653-af55-099c3d8ca0c9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:43.967171 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fda235d5-a0ee-4653-af55-099c3d8ca0c9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:43.967650 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fda235d5-a0ee-4653-af55-099c3d8ca0c9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:43.971700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fda235d5-a0ee-4653-af55-099c3d8ca0c9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:43.971700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-fda235d5-a0ee-4653-af55-099c3d8ca0c9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:44.099052 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-fda235d5-a0ee-4653-af55-099c3d8ca0c9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:44.107715 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-fda235d5-a0ee-4653-af55-099c3d8ca0c9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1594 microversion: 2.1 time: 0.151610 Jul 07 15:42:44.108344 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 554/1100] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:43 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:44.170494 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:44.171240 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] [instance: ab219d06-7e13-4675-9711-a8752c3db63a] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:44.177908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:44.178349 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:44.179103 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:44.179526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:44.192609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] HTTP exception thrown: Instance ab219d06-7e13-4675-9711-a8752c3db63a could not be found. Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Request method failure captured: Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a HTTP/1.1 Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv7CyxqjJmdcnzWIzGW0dBc5g4lbE4MHQ1oUXaDu-emPrNOumzDmHXKHc-jbW0bFjcWyrh8zL-VZQvqNPLL9vmZJDzjXiQZex33mQxChM3PBqrnIQ0pMxkexfGClSq_CfygSULQcuYORm5izik0gDrcYChBmUgGNr4zbgz0DvrMHlxk Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: f90b44820e424210b4dea0abc23ea469 Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-VolumesActionsTest-944480723 Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:42:44.194237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f90b44820e424210b4dea0abc23ea469", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f90b44820e424210b4dea0abc23ea469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90b44820e424210b4dea0abc23ea469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90b44820e424210b4dea0abc23ea469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-VolumesActionsTest-944480723 Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: f90b44820e424210b4dea0abc23ea469 Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-VolumesActionsTest-944480723 Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-VolumesActionsTest-944480723-project Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 03f8ed4d3d5a4447ba2c61b3dd4c314a Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-VolumesActionsTest-944480723-project Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance ab219d06-7e13-4675-9711-a8752c3db63a could not be found. Jul 07 15:42:44.195911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'ab219d06-7e13-4675-9711-a8752c3db63a'} Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab219d06-7e13-4675-9711-a8752c3db63a could not be found. Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:42:44.196820 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab219d06-7e13-4675-9711-a8752c3db63a could not be found. Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab219d06-7e13-4675-9711-a8752c3db63a could not be found. Jul 07 15:42:44.198340 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:42:44.199707 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] Returning 404 to user: Instance ab219d06-7e13-4675-9711-a8752c3db63a could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:42:44.199707 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6212e39c-1098-4b2a-943a-1fd739e8a743 tempest-VolumesActionsTest-944480723 tempest-VolumesActionsTest-944480723-project] 10.222.0.25 "GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a" status: 404 len: 111 microversion: 2.1 time: 0.028888 Jul 07 15:42:44.199707 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 547/1101] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:44 2022] GET /compute/v2.1/servers/ab219d06-7e13-4675-9711-a8752c3db63a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:42:44.390240 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-3a01f605-96ca-4e29-b37b-88b97b4a6d92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:44.390952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-3a01f605-96ca-4e29-b37b-88b97b4a6d92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:44.397088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a01f605-96ca-4e29-b37b-88b97b4a6d92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:44.397535 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a01f605-96ca-4e29-b37b-88b97b4a6d92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:44.398917 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a01f605-96ca-4e29-b37b-88b97b4a6d92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:44.399350 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-3a01f605-96ca-4e29-b37b-88b97b4a6d92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:44.534637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-3a01f605-96ca-4e29-b37b-88b97b4a6d92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:44.542570 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-3a01f605-96ca-4e29-b37b-88b97b4a6d92 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.156326 Jul 07 15:42:44.547846 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 555/1102] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:44 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:45.119351 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-4826e838-90d2-48e4-9f9b-0ed37d78382d req-e543bb56-7bbd-4c8f-bd26-8399900c7c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1cc41e-3a12-4fdc-9cec-0cf589c82e21", "name": "network-vif-plugged", "status": "completed", "tag": "5aa4d37a-551d-4dfc-a30c-bbdfea38d06a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:45.132304 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-4826e838-90d2-48e4-9f9b-0ed37d78382d req-e543bb56-7bbd-4c8f-bd26-8399900c7c3d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:45.132917 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-4826e838-90d2-48e4-9f9b-0ed37d78382d req-e543bb56-7bbd-4c8f-bd26-8399900c7c3d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:45.147938 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-4826e838-90d2-48e4-9f9b-0ed37d78382d req-e543bb56-7bbd-4c8f-bd26-8399900c7c3d service nova] Creating event network-vif-plugged:5aa4d37a-551d-4dfc-a30c-bbdfea38d06a for instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 on hv-cinder-84130 Jul 07 15:42:45.167127 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-4826e838-90d2-48e4-9f9b-0ed37d78382d req-e543bb56-7bbd-4c8f-bd26-8399900c7c3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054319 Jul 07 15:42:45.167751 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 548/1103] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:42:45.559639 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-aad1d20f-ad9f-45d8-afb7-923153644b72 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:45.560258 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-aad1d20f-ad9f-45d8-afb7-923153644b72 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:45.566982 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-aad1d20f-ad9f-45d8-afb7-923153644b72 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:45.567431 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-aad1d20f-ad9f-45d8-afb7-923153644b72 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:45.568229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-aad1d20f-ad9f-45d8-afb7-923153644b72 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:45.568666 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-aad1d20f-ad9f-45d8-afb7-923153644b72 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:45.705210 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-aad1d20f-ad9f-45d8-afb7-923153644b72 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:45.713172 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-aad1d20f-ad9f-45d8-afb7-923153644b72 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.157581 Jul 07 15:42:45.713737 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 556/1104] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:45 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:46.206189 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-8a36c8bd-450b-4279-b6ac-d554763246a3 req-a27d1157-882c-4b51-9cd2-2fb361410bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66906c69-cb44-49e3-ba9b-59dffb9f6181", "tag": "03660176-9b44-4590-8337-3977dc2d927b"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:46.215830 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-8a36c8bd-450b-4279-b6ac-d554763246a3 req-a27d1157-882c-4b51-9cd2-2fb361410bd3 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:46.216513 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-8a36c8bd-450b-4279-b6ac-d554763246a3 req-a27d1157-882c-4b51-9cd2-2fb361410bd3 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:46.230551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-8a36c8bd-450b-4279-b6ac-d554763246a3 req-a27d1157-882c-4b51-9cd2-2fb361410bd3 service nova] Creating event network-changed:03660176-9b44-4590-8337-3977dc2d927b for instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 on hv-cinder-84130 Jul 07 15:42:46.232888 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-8a36c8bd-450b-4279-b6ac-d554763246a3 req-a27d1157-882c-4b51-9cd2-2fb361410bd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032089 Jul 07 15:42:46.233559 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 549/1105] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:46.730880 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-607bd7a2-ac69-45bc-9b21-1d3499c123f4 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:46.731646 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-607bd7a2-ac69-45bc-9b21-1d3499c123f4 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:46.738885 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-607bd7a2-ac69-45bc-9b21-1d3499c123f4 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:46.739320 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-607bd7a2-ac69-45bc-9b21-1d3499c123f4 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:46.740139 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-607bd7a2-ac69-45bc-9b21-1d3499c123f4 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:46.740570 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-607bd7a2-ac69-45bc-9b21-1d3499c123f4 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:46.895263 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-607bd7a2-ac69-45bc-9b21-1d3499c123f4 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:46.904022 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-607bd7a2-ac69-45bc-9b21-1d3499c123f4 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.176827 Jul 07 15:42:46.904686 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 557/1106] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:46 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:47.921694 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-66333e6a-1ed3-4195-b6f7-8dbf5a62c93d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:47.922385 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-66333e6a-1ed3-4195-b6f7-8dbf5a62c93d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:47.928567 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66333e6a-1ed3-4195-b6f7-8dbf5a62c93d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:47.929044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66333e6a-1ed3-4195-b6f7-8dbf5a62c93d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:47.929799 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66333e6a-1ed3-4195-b6f7-8dbf5a62c93d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:47.930229 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66333e6a-1ed3-4195-b6f7-8dbf5a62c93d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:48.061888 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-66333e6a-1ed3-4195-b6f7-8dbf5a62c93d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:48.069341 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-66333e6a-1ed3-4195-b6f7-8dbf5a62c93d tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.152359 Jul 07 15:42:48.069911 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 550/1107] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:47 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:42:48.361098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-308188ea-dd2e-4f39-aaa5-5b72349663fd tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-686680740"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:48.361657 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-308188ea-dd2e-4f39-aaa5-5b72349663fd tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:48.368447 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-308188ea-dd2e-4f39-aaa5-5b72349663fd tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:48.368937 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-308188ea-dd2e-4f39-aaa5-5b72349663fd tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:48.369689 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-308188ea-dd2e-4f39-aaa5-5b72349663fd tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:48.370116 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-308188ea-dd2e-4f39-aaa5-5b72349663fd tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:48.496344 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.network.security_group_api [None req-308188ea-dd2e-4f39-aaa5-5b72349663fd tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Adding security group d4369ade-2dea-4744-9b77-f7acf134ab9b to port 03660176-9b44-4590-8337-3977dc2d927b Jul 07 15:42:48.901593 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-308188ea-dd2e-4f39-aaa5-5b72349663fd tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "POST /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/action" status: 202 len: 0 microversion: 2.1 time: 0.544355 Jul 07 15:42:48.902384 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 558/1108] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:42:48 2022] POST /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:42:48.916123 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-36cc97d9-6080-48e1-aa43-975c96578dec req-a7b4f0e6-1c76-445f-9bbc-d105d998b34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66906c69-cb44-49e3-ba9b-59dffb9f6181", "tag": "03660176-9b44-4590-8337-3977dc2d927b"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:48.919389 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-cbb5a468-0b38-4c1e-883a-48e9e97a9b03 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:48.920187 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-cbb5a468-0b38-4c1e-883a-48e9e97a9b03 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:48.926503 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cbb5a468-0b38-4c1e-883a-48e9e97a9b03 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:48.927090 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cbb5a468-0b38-4c1e-883a-48e9e97a9b03 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:48.927741 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cbb5a468-0b38-4c1e-883a-48e9e97a9b03 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:48.930422 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-cbb5a468-0b38-4c1e-883a-48e9e97a9b03 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:48.940570 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-36cc97d9-6080-48e1-aa43-975c96578dec req-a7b4f0e6-1c76-445f-9bbc-d105d998b34b service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:48.941025 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-36cc97d9-6080-48e1-aa43-975c96578dec req-a7b4f0e6-1c76-445f-9bbc-d105d998b34b service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:48.945619 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:42:48.966808 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-36cc97d9-6080-48e1-aa43-975c96578dec req-a7b4f0e6-1c76-445f-9bbc-d105d998b34b service nova] Creating event network-changed:03660176-9b44-4590-8337-3977dc2d927b for instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 on hv-cinder-84130 Jul 07 15:42:48.977492 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-36cc97d9-6080-48e1-aa43-975c96578dec req-a7b4f0e6-1c76-445f-9bbc-d105d998b34b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065313 Jul 07 15:42:48.978767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 559/1109] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:42:49.088504 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8829b1d7-064a-486c-bfe1-27df5792c69a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:49.089514 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8829b1d7-064a-486c-bfe1-27df5792c69a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:49.098524 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8829b1d7-064a-486c-bfe1-27df5792c69a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:49.103275 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8829b1d7-064a-486c-bfe1-27df5792c69a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:49.106752 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8829b1d7-064a-486c-bfe1-27df5792c69a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:49.107372 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8829b1d7-064a-486c-bfe1-27df5792c69a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:49.124451 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-cbb5a468-0b38-4c1e-883a-48e9e97a9b03 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:49.138282 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-cbb5a468-0b38-4c1e-883a-48e9e97a9b03 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1640 microversion: 2.1 time: 0.231547 Jul 07 15:42:49.138864 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 551/1110] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:48 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1640 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:49.265625 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8829b1d7-064a-486c-bfe1-27df5792c69a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:49.275165 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8829b1d7-064a-486c-bfe1-27df5792c69a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1265 microversion: 2.1 time: 0.192580 Jul 07 15:42:49.275798 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 560/1111] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:49 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:50.293222 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fb911f83-74d6-4c40-8b6e-66c0dc031a3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:50.294237 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fb911f83-74d6-4c40-8b6e-66c0dc031a3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:50.307500 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb911f83-74d6-4c40-8b6e-66c0dc031a3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:50.308330 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb911f83-74d6-4c40-8b6e-66c0dc031a3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:50.309347 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb911f83-74d6-4c40-8b6e-66c0dc031a3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:50.309998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fb911f83-74d6-4c40-8b6e-66c0dc031a3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:50.473421 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fb911f83-74d6-4c40-8b6e-66c0dc031a3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:50.486152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fb911f83-74d6-4c40-8b6e-66c0dc031a3a tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1451 microversion: 2.1 time: 0.196657 Jul 07 15:42:50.489392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 552/1112] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:50 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1451 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:50.505747 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-dfd05ca8-7b5e-47e2-a34b-74b576d18cd8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:42:50.507370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-dfd05ca8-7b5e-47e2-a34b-74b576d18cd8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:42:50.514671 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dfd05ca8-7b5e-47e2-a34b-74b576d18cd8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:50.515451 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dfd05ca8-7b5e-47e2-a34b-74b576d18cd8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:50.516934 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dfd05ca8-7b5e-47e2-a34b-74b576d18cd8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:50.517578 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dfd05ca8-7b5e-47e2-a34b-74b576d18cd8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:50.674851 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-dfd05ca8-7b5e-47e2-a34b-74b576d18cd8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:42:50.683962 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-dfd05ca8-7b5e-47e2-a34b-74b576d18cd8 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1451 microversion: 2.1 time: 0.182115 Jul 07 15:42:50.685336 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 561/1113] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:42:50 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:42:53.270138 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-0d21c9f1-ba36-458e-8139-5561a664bb29 req-df2db0fb-3d47-44b2-a28b-132387814d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1cc41e-3a12-4fdc-9cec-0cf589c82e21", "tag": "5aa4d37a-551d-4dfc-a30c-bbdfea38d06a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:42:53.283682 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-0d21c9f1-ba36-458e-8139-5561a664bb29 req-df2db0fb-3d47-44b2-a28b-132387814d94 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:42:53.284127 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-0d21c9f1-ba36-458e-8139-5561a664bb29 req-df2db0fb-3d47-44b2-a28b-132387814d94 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:42:53.313865 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-0d21c9f1-ba36-458e-8139-5561a664bb29 req-df2db0fb-3d47-44b2-a28b-132387814d94 service nova] Creating event network-changed:5aa4d37a-551d-4dfc-a30c-bbdfea38d06a for instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 on hv-cinder-84130 Jul 07 15:42:53.327256 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-0d21c9f1-ba36-458e-8139-5561a664bb29 req-df2db0fb-3d47-44b2-a28b-132387814d94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059730 Jul 07 15:42:53.328999 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 553/1114] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:43:11.732721 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-36ff0ee2-a8a6-42ea-8a7a-5c78d7a7d9ec tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:43:11.733709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-36ff0ee2-a8a6-42ea-8a7a-5c78d7a7d9ec tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:11.736104 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:43:11.739021 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=12 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:43:11.741842 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-36ff0ee2-a8a6-42ea-8a7a-5c78d7a7d9ec tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:11.742835 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-36ff0ee2-a8a6-42ea-8a7a-5c78d7a7d9ec tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:11.743674 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-36ff0ee2-a8a6-42ea-8a7a-5c78d7a7d9ec tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:11.744103 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-36ff0ee2-a8a6-42ea-8a7a-5c78d7a7d9ec tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:11.921705 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-36ff0ee2-a8a6-42ea-8a7a-5c78d7a7d9ec tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "POST /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/action" status: 202 len: 0 microversion: 2.1 time: 0.192769 Jul 07 15:43:11.925544 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 562/1115] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:43:11 2022] POST /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:43:11.931855 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-da03cc07-cadc-4138-81c1-85a9eba782ae tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:11.932542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-da03cc07-cadc-4138-81c1-85a9eba782ae tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:11.934852 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=15 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:43:11.935515 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=46 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:43:11.940984 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-da03cc07-cadc-4138-81c1-85a9eba782ae tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:11.941432 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-da03cc07-cadc-4138-81c1-85a9eba782ae tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:11.942209 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-da03cc07-cadc-4138-81c1-85a9eba782ae tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:11.942679 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-da03cc07-cadc-4138-81c1-85a9eba782ae tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:12.287701 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-da03cc07-cadc-4138-81c1-85a9eba782ae tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:12.296841 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-da03cc07-cadc-4138-81c1-85a9eba782ae tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1750 microversion: 2.1 time: 0.369656 Jul 07 15:43:12.297499 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 554/1116] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:11 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1750 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:13.315457 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-afb8cb33-7db4-4f56-9d6a-b349610cf343 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:13.316182 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-afb8cb33-7db4-4f56-9d6a-b349610cf343 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:13.322544 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afb8cb33-7db4-4f56-9d6a-b349610cf343 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:13.322989 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afb8cb33-7db4-4f56-9d6a-b349610cf343 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:13.323789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afb8cb33-7db4-4f56-9d6a-b349610cf343 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:13.324218 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-afb8cb33-7db4-4f56-9d6a-b349610cf343 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:13.639729 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-afb8cb33-7db4-4f56-9d6a-b349610cf343 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:13.649001 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-afb8cb33-7db4-4f56-9d6a-b349610cf343 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1755 microversion: 2.1 time: 0.337462 Jul 07 15:43:13.649491 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 563/1117] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:13 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1755 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:14.666995 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f2eaaf60-8f81-4299-bb84-5217a7955aaa tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:14.667630 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f2eaaf60-8f81-4299-bb84-5217a7955aaa tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:14.674034 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f2eaaf60-8f81-4299-bb84-5217a7955aaa tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:14.674482 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f2eaaf60-8f81-4299-bb84-5217a7955aaa tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:14.675244 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f2eaaf60-8f81-4299-bb84-5217a7955aaa tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:14.675711 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f2eaaf60-8f81-4299-bb84-5217a7955aaa tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:14.821651 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f2eaaf60-8f81-4299-bb84-5217a7955aaa tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:14.830487 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f2eaaf60-8f81-4299-bb84-5217a7955aaa tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1755 microversion: 2.1 time: 0.167908 Jul 07 15:43:14.831051 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 555/1118] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:14 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:15.848289 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-b92677d8-4206-4e52-ad94-2b6814422937 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:15.848906 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-b92677d8-4206-4e52-ad94-2b6814422937 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:15.856175 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b92677d8-4206-4e52-ad94-2b6814422937 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:15.856624 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b92677d8-4206-4e52-ad94-2b6814422937 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:15.857380 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b92677d8-4206-4e52-ad94-2b6814422937 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:15.857811 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-b92677d8-4206-4e52-ad94-2b6814422937 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:15.999899 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-b92677d8-4206-4e52-ad94-2b6814422937 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:16.007766 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-b92677d8-4206-4e52-ad94-2b6814422937 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1755 microversion: 2.1 time: 0.163326 Jul 07 15:43:16.008331 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 564/1119] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:15 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:16.184604 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1812883139", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "networks": [{"uuid": "694ea20f-c7d1-40b1-860a-8001a8d19125"}]}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:43:16.235222 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] validate_networks() for [('694ea20f-c7d1-40b1-860a-8001a8d19125', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:43:16.572561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:43:16.572987 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:43:16.573460 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:43:16.573900 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:43:16.574315 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:43:16.583165 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:16.583639 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:16.584443 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:16.584878 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:16.601193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Getting quotas for project d087fee0c67c47f98f424fbdb919b547. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:43:16.605592 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Getting quotas for user fedbf09a8fe146709e18f019a18854c6 and project d087fee0c67c47f98f424fbdb919b547. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:43:16.616621 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:43:16.619359 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:43:16.734427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7d388b6d-e9f5-4330-8880-23977ea88dcd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553561 Jul 07 15:43:16.735072 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 556/1120] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:43:16.745482 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-de2626a6-9971-4e32-a1a3-88b28707b9ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:16.746135 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-de2626a6-9971-4e32-a1a3-88b28707b9ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:16.803802 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-de2626a6-9971-4e32-a1a3-88b28707b9ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:16.810396 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-de2626a6-9971-4e32-a1a3-88b28707b9ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1219 microversion: 2.1 time: 0.068992 Jul 07 15:43:16.810984 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 565/1121] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:16 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:17.029518 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-6411af69-9c6b-45cb-a17e-eb80250ab1b6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:17.030128 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-6411af69-9c6b-45cb-a17e-eb80250ab1b6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:17.036852 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6411af69-9c6b-45cb-a17e-eb80250ab1b6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:17.049708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6411af69-9c6b-45cb-a17e-eb80250ab1b6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:17.049708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6411af69-9c6b-45cb-a17e-eb80250ab1b6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:17.049708 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-6411af69-9c6b-45cb-a17e-eb80250ab1b6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:17.184808 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-6411af69-9c6b-45cb-a17e-eb80250ab1b6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:17.192847 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-6411af69-9c6b-45cb-a17e-eb80250ab1b6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1755 microversion: 2.1 time: 0.167195 Jul 07 15:43:17.195736 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 557/1122] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:17 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:17.827088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8a91768b-c68a-4e67-9814-25374e67c7ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:17.827874 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8a91768b-c68a-4e67-9814-25374e67c7ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:17.834455 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8a91768b-c68a-4e67-9814-25374e67c7ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:17.834917 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8a91768b-c68a-4e67-9814-25374e67c7ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:17.835911 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8a91768b-c68a-4e67-9814-25374e67c7ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:17.836350 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8a91768b-c68a-4e67-9814-25374e67c7ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:17.898579 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8a91768b-c68a-4e67-9814-25374e67c7ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:17.906754 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8a91768b-c68a-4e67-9814-25374e67c7ec tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1215 microversion: 2.1 time: 0.083764 Jul 07 15:43:17.907318 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 566/1123] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:17 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:18.210553 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-64833fda-7659-423d-8b3d-ee3aad30c36b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:18.211079 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-64833fda-7659-423d-8b3d-ee3aad30c36b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:18.218433 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-64833fda-7659-423d-8b3d-ee3aad30c36b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:18.219239 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-64833fda-7659-423d-8b3d-ee3aad30c36b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:18.220029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-64833fda-7659-423d-8b3d-ee3aad30c36b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:18.220612 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-64833fda-7659-423d-8b3d-ee3aad30c36b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:18.367035 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-64833fda-7659-423d-8b3d-ee3aad30c36b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:18.376453 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-64833fda-7659-423d-8b3d-ee3aad30c36b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1755 microversion: 2.1 time: 0.169773 Jul 07 15:43:18.377019 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 558/1124] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:18 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:18.924679 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-1b93f360-e703-4566-a396-782889df47d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:18.925288 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-1b93f360-e703-4566-a396-782889df47d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:18.932845 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b93f360-e703-4566-a396-782889df47d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:18.933291 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b93f360-e703-4566-a396-782889df47d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:18.936351 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b93f360-e703-4566-a396-782889df47d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:18.936351 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-1b93f360-e703-4566-a396-782889df47d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:19.010252 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-1b93f360-e703-4566-a396-782889df47d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:19.017852 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-1b93f360-e703-4566-a396-782889df47d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1277 microversion: 2.1 time: 0.097142 Jul 07 15:43:19.018418 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 567/1125] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:18 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:19.394848 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a610babe-f2a6-4952-b6eb-a781f17f9764 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:19.395451 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a610babe-f2a6-4952-b6eb-a781f17f9764 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:19.401895 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a610babe-f2a6-4952-b6eb-a781f17f9764 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:19.402337 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a610babe-f2a6-4952-b6eb-a781f17f9764 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:19.403101 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a610babe-f2a6-4952-b6eb-a781f17f9764 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:19.403531 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a610babe-f2a6-4952-b6eb-a781f17f9764 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:19.567334 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a610babe-f2a6-4952-b6eb-a781f17f9764 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:19.575501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a610babe-f2a6-4952-b6eb-a781f17f9764 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1755 microversion: 2.1 time: 0.184938 Jul 07 15:43:19.576104 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 559/1126] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:19 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:20.035602 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-f8d5cde3-7488-4a14-863f-8b369564dc00 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:20.036245 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-f8d5cde3-7488-4a14-863f-8b369564dc00 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:20.043339 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f8d5cde3-7488-4a14-863f-8b369564dc00 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:20.043806 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f8d5cde3-7488-4a14-863f-8b369564dc00 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:20.044582 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f8d5cde3-7488-4a14-863f-8b369564dc00 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:20.045013 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-f8d5cde3-7488-4a14-863f-8b369564dc00 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:20.170507 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-f8d5cde3-7488-4a14-863f-8b369564dc00 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:20.177969 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-f8d5cde3-7488-4a14-863f-8b369564dc00 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1319 microversion: 2.1 time: 0.146342 Jul 07 15:43:20.178522 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 568/1127] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:20 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:20.236580 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-0d4959f3-965f-420f-bd08-817620bbe56f req-4d0f2c8b-1fab-423a-b819-66ba4c807079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d", "tag": "eb909567-84ac-417c-9984-ac50a3eacf25"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:43:20.245027 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-0d4959f3-965f-420f-bd08-817620bbe56f req-4d0f2c8b-1fab-423a-b819-66ba4c807079 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:20.245464 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-0d4959f3-965f-420f-bd08-817620bbe56f req-4d0f2c8b-1fab-423a-b819-66ba4c807079 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:20.256419 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-0d4959f3-965f-420f-bd08-817620bbe56f req-4d0f2c8b-1fab-423a-b819-66ba4c807079 service nova] Creating event network-changed:eb909567-84ac-417c-9984-ac50a3eacf25 for instance c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d on hv-cinder-84130 Jul 07 15:43:20.261721 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-0d4959f3-965f-420f-bd08-817620bbe56f req-4d0f2c8b-1fab-423a-b819-66ba4c807079 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028882 Jul 07 15:43:20.262581 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 560/1128] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:43:20.593720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4779cac1-99cb-488a-9312-090690ba2efe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:20.594335 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4779cac1-99cb-488a-9312-090690ba2efe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:20.600592 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4779cac1-99cb-488a-9312-090690ba2efe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:20.601192 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4779cac1-99cb-488a-9312-090690ba2efe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:20.601930 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4779cac1-99cb-488a-9312-090690ba2efe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:20.602369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4779cac1-99cb-488a-9312-090690ba2efe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:20.750231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4779cac1-99cb-488a-9312-090690ba2efe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:20.758084 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4779cac1-99cb-488a-9312-090690ba2efe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1755 microversion: 2.1 time: 0.168576 Jul 07 15:43:20.758641 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 569/1129] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:20 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:21.195124 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4e1956f7-dfcb-46b8-b899-da0a26fb0256 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:21.195864 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4e1956f7-dfcb-46b8-b899-da0a26fb0256 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:21.202077 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e1956f7-dfcb-46b8-b899-da0a26fb0256 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:21.202466 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e1956f7-dfcb-46b8-b899-da0a26fb0256 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:21.203214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e1956f7-dfcb-46b8-b899-da0a26fb0256 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:21.203670 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e1956f7-dfcb-46b8-b899-da0a26fb0256 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:21.333699 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-4e1956f7-dfcb-46b8-b899-da0a26fb0256 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:21.341164 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4e1956f7-dfcb-46b8-b899-da0a26fb0256 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1319 microversion: 2.1 time: 0.150693 Jul 07 15:43:21.341733 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 561/1130] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:21 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:21.776413 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ec5646fa-f339-41ec-9078-cceb3c82c32c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:21.777017 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ec5646fa-f339-41ec-9078-cceb3c82c32c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:21.783631 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec5646fa-f339-41ec-9078-cceb3c82c32c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:21.784082 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec5646fa-f339-41ec-9078-cceb3c82c32c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:21.784845 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec5646fa-f339-41ec-9078-cceb3c82c32c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:21.785279 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec5646fa-f339-41ec-9078-cceb3c82c32c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:21.927949 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-ec5646fa-f339-41ec-9078-cceb3c82c32c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:21.935846 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ec5646fa-f339-41ec-9078-cceb3c82c32c tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1755 microversion: 2.1 time: 0.163883 Jul 07 15:43:21.936414 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 570/1131] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:21 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:22.357888 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f08e734c-7f71-46e5-8620-36dca3586fff tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:22.358603 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f08e734c-7f71-46e5-8620-36dca3586fff tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:22.365365 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f08e734c-7f71-46e5-8620-36dca3586fff tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:22.365806 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f08e734c-7f71-46e5-8620-36dca3586fff tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:22.366554 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f08e734c-7f71-46e5-8620-36dca3586fff tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:22.366983 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f08e734c-7f71-46e5-8620-36dca3586fff tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:22.507090 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-f08e734c-7f71-46e5-8620-36dca3586fff tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:22.515792 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f08e734c-7f71-46e5-8620-36dca3586fff tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1319 microversion: 2.1 time: 0.161738 Jul 07 15:43:22.516419 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 562/1132] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:22 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:22.952840 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0fa60b46-00d6-4dbe-bd9f-fa1a6c3ff426 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:22.953588 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0fa60b46-00d6-4dbe-bd9f-fa1a6c3ff426 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:22.959997 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0fa60b46-00d6-4dbe-bd9f-fa1a6c3ff426 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:22.960510 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0fa60b46-00d6-4dbe-bd9f-fa1a6c3ff426 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:22.961254 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0fa60b46-00d6-4dbe-bd9f-fa1a6c3ff426 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:22.961690 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0fa60b46-00d6-4dbe-bd9f-fa1a6c3ff426 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:23.107476 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0fa60b46-00d6-4dbe-bd9f-fa1a6c3ff426 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:23.116213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0fa60b46-00d6-4dbe-bd9f-fa1a6c3ff426 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1755 microversion: 2.1 time: 0.167283 Jul 07 15:43:23.116781 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 571/1133] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:22 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:23.532381 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-20d33120-9edb-4f93-b7e1-8ed11d28c8e2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:23.532980 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-20d33120-9edb-4f93-b7e1-8ed11d28c8e2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:23.539360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-20d33120-9edb-4f93-b7e1-8ed11d28c8e2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:23.539832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-20d33120-9edb-4f93-b7e1-8ed11d28c8e2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:23.540576 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-20d33120-9edb-4f93-b7e1-8ed11d28c8e2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:23.541000 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-20d33120-9edb-4f93-b7e1-8ed11d28c8e2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:23.665299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-20d33120-9edb-4f93-b7e1-8ed11d28c8e2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:23.672649 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-20d33120-9edb-4f93-b7e1-8ed11d28c8e2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1319 microversion: 2.1 time: 0.144111 Jul 07 15:43:23.673211 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 563/1134] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:23 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:24.133582 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8df3a25b-2ff0-4966-a7d1-ccce35fe85f9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:24.134212 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8df3a25b-2ff0-4966-a7d1-ccce35fe85f9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:24.140689 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8df3a25b-2ff0-4966-a7d1-ccce35fe85f9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:24.141258 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8df3a25b-2ff0-4966-a7d1-ccce35fe85f9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:24.142012 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8df3a25b-2ff0-4966-a7d1-ccce35fe85f9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:24.142439 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8df3a25b-2ff0-4966-a7d1-ccce35fe85f9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:24.287953 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8df3a25b-2ff0-4966-a7d1-ccce35fe85f9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:24.296440 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8df3a25b-2ff0-4966-a7d1-ccce35fe85f9 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1758 microversion: 2.1 time: 0.166739 Jul 07 15:43:24.297002 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 572/1135] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:24 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:24.688979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0479f18a-b4e3-4e68-a0a0-b0cea0d31254 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:24.689583 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0479f18a-b4e3-4e68-a0a0-b0cea0d31254 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:24.695902 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0479f18a-b4e3-4e68-a0a0-b0cea0d31254 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:24.696380 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0479f18a-b4e3-4e68-a0a0-b0cea0d31254 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:24.697131 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0479f18a-b4e3-4e68-a0a0-b0cea0d31254 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:24.697558 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0479f18a-b4e3-4e68-a0a0-b0cea0d31254 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:24.728229 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-abab5bcd-b2e6-4cc5-995c-767523d991bb req-e6c13a96-1bce-4af2-9cd4-5695e342bbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d", "name": "network-vif-plugged", "status": "completed", "tag": "eb909567-84ac-417c-9984-ac50a3eacf25"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:43:24.741694 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-abab5bcd-b2e6-4cc5-995c-767523d991bb req-e6c13a96-1bce-4af2-9cd4-5695e342bbca service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:24.742134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-abab5bcd-b2e6-4cc5-995c-767523d991bb req-e6c13a96-1bce-4af2-9cd4-5695e342bbca service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:24.759941 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-abab5bcd-b2e6-4cc5-995c-767523d991bb req-e6c13a96-1bce-4af2-9cd4-5695e342bbca service nova] Creating event network-vif-plugged:eb909567-84ac-417c-9984-ac50a3eacf25 for instance c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d on hv-cinder-84130 Jul 07 15:43:24.771049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-abab5bcd-b2e6-4cc5-995c-767523d991bb req-e6c13a96-1bce-4af2-9cd4-5695e342bbca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041064 Jul 07 15:43:24.771049 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 573/1136] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:43:24.833552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0479f18a-b4e3-4e68-a0a0-b0cea0d31254 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:24.841907 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0479f18a-b4e3-4e68-a0a0-b0cea0d31254 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1319 microversion: 2.1 time: 0.156720 Jul 07 15:43:24.842476 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 564/1137] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:24 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:25.859821 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-6c06c60d-c00b-4633-b330-945a60a439fd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:25.860518 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-6c06c60d-c00b-4633-b330-945a60a439fd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:25.866998 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6c06c60d-c00b-4633-b330-945a60a439fd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:25.867445 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6c06c60d-c00b-4633-b330-945a60a439fd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:25.868258 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6c06c60d-c00b-4633-b330-945a60a439fd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:25.868689 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-6c06c60d-c00b-4633-b330-945a60a439fd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:26.000130 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-6c06c60d-c00b-4633-b330-945a60a439fd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:26.007495 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-6c06c60d-c00b-4633-b330-945a60a439fd tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1319 microversion: 2.1 time: 0.152505 Jul 07 15:43:26.008079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 574/1138] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:25 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:27.026505 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7a5d2d7d-cef8-4c73-a6e3-a7cef2ebeb27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:43:27.027135 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7a5d2d7d-cef8-4c73-a6e3-a7cef2ebeb27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:27.029534 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:43:27.030180 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=6 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:43:27.034970 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7a5d2d7d-cef8-4c73-a6e3-a7cef2ebeb27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:27.035410 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7a5d2d7d-cef8-4c73-a6e3-a7cef2ebeb27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:27.036185 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7a5d2d7d-cef8-4c73-a6e3-a7cef2ebeb27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:27.036620 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7a5d2d7d-cef8-4c73-a6e3-a7cef2ebeb27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:27.165611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-7a5d2d7d-cef8-4c73-a6e3-a7cef2ebeb27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:43:27.173078 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7a5d2d7d-cef8-4c73-a6e3-a7cef2ebeb27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1508 microversion: 2.1 time: 0.151015 Jul 07 15:43:27.173644 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 565/1139] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:43:27 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:43:43.562708 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7bbe3453-99b9-460f-8cc4-dfc86d49dc05 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20ad3594-c277-4144-a830-2dbb443dc0e1", "device": "/dev/sdb"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:43:43.564333 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7bbe3453-99b9-460f-8cc4-dfc86d49dc05 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:43:43.566267 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell0:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:43:43.567141 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=28 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:43:43.567797 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:43:43.572577 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7bbe3453-99b9-460f-8cc4-dfc86d49dc05 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:43.573022 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7bbe3453-99b9-460f-8cc4-dfc86d49dc05 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:43.573778 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7bbe3453-99b9-460f-8cc4-dfc86d49dc05 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:43:43.574209 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7bbe3453-99b9-460f-8cc4-dfc86d49dc05 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:43:44.194373 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7bbe3453-99b9-460f-8cc4-dfc86d49dc05 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "POST /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.636091 Jul 07 15:43:44.194894 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 575/1140] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:43:43 2022] POST /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:08.643273 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0718ebcb-c674-4f2e-bae1-a1690fbe9675 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:08.643850 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0718ebcb-c674-4f2e-bae1-a1690fbe9675 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:08.645755 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:08.646498 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=64 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:08.651202 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0718ebcb-c674-4f2e-bae1-a1690fbe9675 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:08.651690 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0718ebcb-c674-4f2e-bae1-a1690fbe9675 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:08.652466 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0718ebcb-c674-4f2e-bae1-a1690fbe9675 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:08.652883 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0718ebcb-c674-4f2e-bae1-a1690fbe9675 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:08.737722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-0718ebcb-c674-4f2e-bae1-a1690fbe9675 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lazy-loading 'services' on Instance uuid c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:44:08.898052 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0718ebcb-c674-4f2e-bae1-a1690fbe9675 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d/os-volume_attachments/20ad3594-c277-4144-a830-2dbb443dc0e1" status: 202 len: 0 microversion: 2.1 time: 0.258583 Jul 07 15:44:08.898578 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 566/1141] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:44:08 2022] DELETE /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d/os-volume_attachments/20ad3594-c277-4144-a830-2dbb443dc0e1 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:44:10.009236 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:10.010014 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:10.014679 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-28bfbc1f-388a-4050-bd67-f7afdc723929 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:10.015262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-28bfbc1f-388a-4050-bd67-f7afdc723929 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:10.021324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-28bfbc1f-388a-4050-bd67-f7afdc723929 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:10.021804 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-28bfbc1f-388a-4050-bd67-f7afdc723929 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:10.022569 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-28bfbc1f-388a-4050-bd67-f7afdc723929 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:10.023000 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-28bfbc1f-388a-4050-bd67-f7afdc723929 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:10.047659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-28bfbc1f-388a-4050-bd67-f7afdc723929 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:44:10.282389 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-28bfbc1f-388a-4050-bd67-f7afdc723929 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 204 len: 0 microversion: 2.1 time: 0.274297 Jul 07 15:44:10.282893 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 576/1142] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:44:10 2022] DELETE /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:44:10.292344 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-abfe19f0-b8e7-4794-888b-98c99b16cb1c tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:10.294303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-abfe19f0-b8e7-4794-888b-98c99b16cb1c tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:10.300098 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-abfe19f0-b8e7-4794-888b-98c99b16cb1c tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:10.300541 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-abfe19f0-b8e7-4794-888b-98c99b16cb1c tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:10.301298 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-abfe19f0-b8e7-4794-888b-98c99b16cb1c tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:10.301725 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-abfe19f0-b8e7-4794-888b-98c99b16cb1c tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:10.451034 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-abfe19f0-b8e7-4794-888b-98c99b16cb1c tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:10.458640 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-abfe19f0-b8e7-4794-888b-98c99b16cb1c tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1514 microversion: 2.1 time: 0.171109 Jul 07 15:44:10.459203 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 567/1143] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:10 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:11.476860 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-8e6e43e9-1ca0-47cc-ad83-029c5ed0ee78 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:11.477559 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-8e6e43e9-1ca0-47cc-ad83-029c5ed0ee78 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:11.484764 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e6e43e9-1ca0-47cc-ad83-029c5ed0ee78 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:11.485209 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e6e43e9-1ca0-47cc-ad83-029c5ed0ee78 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:11.485972 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e6e43e9-1ca0-47cc-ad83-029c5ed0ee78 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:11.486404 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-8e6e43e9-1ca0-47cc-ad83-029c5ed0ee78 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:11.615942 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-8e6e43e9-1ca0-47cc-ad83-029c5ed0ee78 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:11.623710 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-8e6e43e9-1ca0-47cc-ad83-029c5ed0ee78 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1514 microversion: 2.1 time: 0.151207 Jul 07 15:44:11.624267 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 577/1144] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:11 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:12.642351 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-d55a44e2-9060-40dc-8c24-08e5d9c8005a tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:12.643026 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-d55a44e2-9060-40dc-8c24-08e5d9c8005a tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:12.659031 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d55a44e2-9060-40dc-8c24-08e5d9c8005a tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:12.659934 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d55a44e2-9060-40dc-8c24-08e5d9c8005a tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:12.661184 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d55a44e2-9060-40dc-8c24-08e5d9c8005a tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:12.661629 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-d55a44e2-9060-40dc-8c24-08e5d9c8005a tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:12.731256 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-d55a44e2-9060-40dc-8c24-08e5d9c8005a tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:12.738601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-d55a44e2-9060-40dc-8c24-08e5d9c8005a tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1472 microversion: 2.1 time: 0.101033 Jul 07 15:44:12.739811 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 568/1145] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:12 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1472 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:12.769136 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-ca106c56-5563-45da-8d81-54852b891462 req-8c875af4-0d63-4ac9-8f51-6daf5e7d7ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d", "name": "network-vif-deleted", "tag": "eb909567-84ac-417c-9984-ac50a3eacf25"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:12.778463 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-ca106c56-5563-45da-8d81-54852b891462 req-8c875af4-0d63-4ac9-8f51-6daf5e7d7ced service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:12.778941 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-ca106c56-5563-45da-8d81-54852b891462 req-8c875af4-0d63-4ac9-8f51-6daf5e7d7ced service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:12.790348 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-ca106c56-5563-45da-8d81-54852b891462 req-8c875af4-0d63-4ac9-8f51-6daf5e7d7ced service nova] Creating event network-vif-deleted:eb909567-84ac-417c-9984-ac50a3eacf25 for instance c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d on hv-cinder-84130 Jul 07 15:44:12.795784 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-ca106c56-5563-45da-8d81-54852b891462 req-8c875af4-0d63-4ac9-8f51-6daf5e7d7ced service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102454 Jul 07 15:44:12.796381 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 578/1146] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:44:13.754843 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:13.755542 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:13.761895 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:13.762341 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:13.763110 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:13.763540 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:13.794526 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:13.794890 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:13.795998 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lazy-loading 'fault' on Instance uuid c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:44:13.835734 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:13.843546 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0105b39c-665f-440a-92ff-fb379cee1989 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 200 len: 1309 microversion: 2.1 time: 0.092562 Jul 07 15:44:13.844129 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 569/1147] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:13 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:14.862082 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:14.862781 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:14.869249 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:14.869696 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:14.870453 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:14.870888 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:14.884354 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] HTTP exception thrown: Instance c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d could not be found. Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Request method failure captured: Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d HTTP/1.1 Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv8Sj6qUyY4Qzw06Gh6tWK38bZnWNaTofJquwsHTwZQITXvDmFs98TuZ2LDr7L2m-SBzEomnC5DF7O1IV09Pw_0HQ_erAtNnT_dRnD4UFn5F58p0kCZluB7sUOVw6C9f7WoAb3OUoaQoc-A7Tw8O1idYkMmWSGLj_Bg_LoZ74C_-iK8 Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: d087fee0c67c47f98f424fbdb919b547 Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1497602297 Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:44:14.885931 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d087fee0c67c47f98f424fbdb919b547", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d087fee0c67c47f98f424fbdb919b547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d087fee0c67c47f98f424fbdb919b547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d087fee0c67c47f98f424fbdb919b547"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-VolumesSnapshotTestJSON-1497602297 Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: d087fee0c67c47f98f424fbdb919b547 Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1497602297 Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-VolumesSnapshotTestJSON-1497602297-project Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: fedbf09a8fe146709e18f019a18854c6 Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-VolumesSnapshotTestJSON-1497602297-project Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d could not be found. Jul 07 15:44:14.887709 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': 'c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d'} Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d could not be found. Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:44:14.888693 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d could not be found. Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d could not be found. Jul 07 15:44:14.890150 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:14.891368 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Returning 404 to user: Instance c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:44:14.891368 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4738b8b1-3128-4af1-a7fd-867a58b6642b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d" status: 404 len: 111 microversion: 2.1 time: 0.030432 Jul 07 15:44:14.891368 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 579/1148] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:14 2022] GET /compute/v2.1/servers/c9b5eb0c-aa15-4ce5-97d5-b86de8d28a7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:44:24.166316 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-24fbe54b-42ca-4652-b515-701b93957b90 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:24.166819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-24fbe54b-42ca-4652-b515-701b93957b90 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:24.168608 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-f1503664-ad43-4a8c-8f89-53c8a6cba0fe req-87ff3ae4-8e33-41ea-9a42-bff17eb8b10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1cc41e-3a12-4fdc-9cec-0cf589c82e21", "tag": "5aa4d37a-551d-4dfc-a30c-bbdfea38d06a"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:24.169383 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=10 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:24.170030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:24.175919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-24fbe54b-42ca-4652-b515-701b93957b90 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:24.176626 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-24fbe54b-42ca-4652-b515-701b93957b90 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:24.177386 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-24fbe54b-42ca-4652-b515-701b93957b90 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:24.178044 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-24fbe54b-42ca-4652-b515-701b93957b90 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:24.178172 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-f1503664-ad43-4a8c-8f89-53c8a6cba0fe req-87ff3ae4-8e33-41ea-9a42-bff17eb8b10d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:24.178532 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-f1503664-ad43-4a8c-8f89-53c8a6cba0fe req-87ff3ae4-8e33-41ea-9a42-bff17eb8b10d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:24.190770 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-f1503664-ad43-4a8c-8f89-53c8a6cba0fe req-87ff3ae4-8e33-41ea-9a42-bff17eb8b10d service nova] Creating event network-changed:5aa4d37a-551d-4dfc-a30c-bbdfea38d06a for instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 on hv-cinder-84130 Jul 07 15:44:24.196697 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-f1503664-ad43-4a8c-8f89-53c8a6cba0fe req-87ff3ae4-8e33-41ea-9a42-bff17eb8b10d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031441 Jul 07 15:44:24.197509 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 580/1149] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:44:24.226958 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-24fbe54b-42ca-4652-b515-701b93957b90 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Going to try to terminate instance {{(pid=124720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:44:24.619024 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-24fbe54b-42ca-4652-b515-701b93957b90 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "DELETE /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 204 len: 0 microversion: 2.1 time: 0.456875 Jul 07 15:44:24.622715 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 570/1150] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:44:24 2022] DELETE /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:44:24.628547 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-81376b41-7e2a-4af8-b494-2d23deeaf543 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:24.629311 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-81376b41-7e2a-4af8-b494-2d23deeaf543 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:24.635508 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-81376b41-7e2a-4af8-b494-2d23deeaf543 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:24.635992 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-81376b41-7e2a-4af8-b494-2d23deeaf543 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:24.636754 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-81376b41-7e2a-4af8-b494-2d23deeaf543 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:24.637183 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-81376b41-7e2a-4af8-b494-2d23deeaf543 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:24.775891 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-81376b41-7e2a-4af8-b494-2d23deeaf543 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:24.784098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-81376b41-7e2a-4af8-b494-2d23deeaf543 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1576 microversion: 2.1 time: 0.159890 Jul 07 15:44:24.784659 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 581/1151] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:24 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:25.200356 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-285296174", "imageRef": "c40b06ce-81be-4766-9a67-54cdb8ef5f24", "flavorRef": "452", "networks": [{"uuid": "694ea20f-c7d1-40b1-860a-8001a8d19125"}]}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:25.256792 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.network.neutron [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] validate_networks() for [('694ea20f-c7d1-40b1-860a-8001a8d19125', None, None, None, None, None)] {{(pid=124720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 15:44:25.665214 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Flavor limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 15:44:25.665665 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Image limits 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 15:44:25.666162 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Flavor pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 15:44:25.666569 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Image pref 0:0:0 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 15:44:25.667003 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.virt.hardware [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 15:44:25.676507 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:25.676900 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:25.677689 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:25.678120 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:25.695002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Getting quotas for project d087fee0c67c47f98f424fbdb919b547. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 15:44:25.698919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.quota [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Getting quotas for user fedbf09a8fe146709e18f019a18854c6 and project d087fee0c67c47f98f424fbdb919b547. Resources: {'instances', 'cores', 'ram'} {{(pid=124720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 15:44:25.721416 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Going to run 1 instances... {{(pid=124720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 15:44:25.723800 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c40b06ce-81be-4766-9a67-54cdb8ef5f24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 15:44:25.802846 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-80448822-ac20-4645-9a9c-7581f522c317 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:25.803444 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-80448822-ac20-4645-9a9c-7581f522c317 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:25.809865 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-80448822-ac20-4645-9a9c-7581f522c317 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:25.810305 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-80448822-ac20-4645-9a9c-7581f522c317 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:25.811094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-80448822-ac20-4645-9a9c-7581f522c317 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:25.811521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-80448822-ac20-4645-9a9c-7581f522c317 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:25.826821 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-0f6014a9-8ed4-42ca-aefc-94fde5efbfe2 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630608 Jul 07 15:44:25.827490 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 571/1152] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Jul 7 15:44:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 15:44:25.837222 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fc95259b-cc4d-4d62-b9f8-ff6789b92462 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:25.838225 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fc95259b-cc4d-4d62-b9f8-ff6789b92462 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:25.916816 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-fc95259b-cc4d-4d62-b9f8-ff6789b92462 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:25.924605 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fc95259b-cc4d-4d62-b9f8-ff6789b92462 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1218 microversion: 2.1 time: 0.091156 Jul 07 15:44:25.925552 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 572/1153] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:25 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:44:25.981243 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-80448822-ac20-4645-9a9c-7581f522c317 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:25.989757 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-80448822-ac20-4645-9a9c-7581f522c317 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1576 microversion: 2.1 time: 0.190794 Jul 07 15:44:25.990317 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 582/1154] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:25 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:44:26.822230 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-35caabea-6705-41ef-8c0c-3e0182a935dd req-ac7f7137-67fb-44f7-90da-0fb4968e0f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1cc41e-3a12-4fdc-9cec-0cf589c82e21", "name": "network-vif-deleted", "tag": "5aa4d37a-551d-4dfc-a30c-bbdfea38d06a"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:26.824292 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-35caabea-6705-41ef-8c0c-3e0182a935dd req-ac7f7137-67fb-44f7-90da-0fb4968e0f32 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:26.824729 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-35caabea-6705-41ef-8c0c-3e0182a935dd req-ac7f7137-67fb-44f7-90da-0fb4968e0f32 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:26.836158 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-35caabea-6705-41ef-8c0c-3e0182a935dd req-ac7f7137-67fb-44f7-90da-0fb4968e0f32 service nova] Creating event network-vif-deleted:5aa4d37a-551d-4dfc-a30c-bbdfea38d06a for instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 on hv-cinder-84130 Jul 07 15:44:26.841114 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-35caabea-6705-41ef-8c0c-3e0182a935dd req-ac7f7137-67fb-44f7-90da-0fb4968e0f32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029109 Jul 07 15:44:26.841701 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 573/1155] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:26.941720 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-4df0ceec-1da4-4b75-829b-9083fbc888b7 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:26.942308 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-4df0ceec-1da4-4b75-829b-9083fbc888b7 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:26.948843 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4df0ceec-1da4-4b75-829b-9083fbc888b7 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:26.949290 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4df0ceec-1da4-4b75-829b-9083fbc888b7 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:26.950052 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4df0ceec-1da4-4b75-829b-9083fbc888b7 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:26.950492 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-4df0ceec-1da4-4b75-829b-9083fbc888b7 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:27.006917 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-a4030a02-c172-4753-81b1-980b294783b9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:27.007668 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-a4030a02-c172-4753-81b1-980b294783b9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:27.014079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-4df0ceec-1da4-4b75-829b-9083fbc888b7 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:27.015352 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a4030a02-c172-4753-81b1-980b294783b9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:27.016312 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a4030a02-c172-4753-81b1-980b294783b9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:27.017360 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a4030a02-c172-4753-81b1-980b294783b9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:27.018425 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-a4030a02-c172-4753-81b1-980b294783b9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:27.022912 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-4df0ceec-1da4-4b75-829b-9083fbc888b7 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1222 microversion: 2.1 time: 0.085149 Jul 07 15:44:27.023498 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 583/1156] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:26 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:27.082177 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-a4030a02-c172-4753-81b1-980b294783b9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:27.090405 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-a4030a02-c172-4753-81b1-980b294783b9 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1224 microversion: 2.1 time: 0.087677 Jul 07 15:44:27.091113 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 574/1157] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:27 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:27.695653 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-a6306f75-a9f4-4927-b8d9-ca5bd083bbfe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-686680740"}} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:27.696437 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-a6306f75-a9f4-4927-b8d9-ca5bd083bbfe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:27.702925 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a6306f75-a9f4-4927-b8d9-ca5bd083bbfe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:27.703370 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a6306f75-a9f4-4927-b8d9-ca5bd083bbfe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:27.704167 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a6306f75-a9f4-4927-b8d9-ca5bd083bbfe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:27.704603 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-a6306f75-a9f4-4927-b8d9-ca5bd083bbfe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:27.855347 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.network.security_group_api [None req-a6306f75-a9f4-4927-b8d9-ca5bd083bbfe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Removing security group d4369ade-2dea-4744-9b77-f7acf134ab9b from port 03660176-9b44-4590-8337-3977dc2d927b Jul 07 15:44:28.040882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3cba5c1d-2b78-4a35-ba0e-f9a8e9849e04 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:28.041737 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3cba5c1d-2b78-4a35-ba0e-f9a8e9849e04 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:28.049392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3cba5c1d-2b78-4a35-ba0e-f9a8e9849e04 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:28.049392 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3cba5c1d-2b78-4a35-ba0e-f9a8e9849e04 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:28.049647 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3cba5c1d-2b78-4a35-ba0e-f9a8e9849e04 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:28.050057 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3cba5c1d-2b78-4a35-ba0e-f9a8e9849e04 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:28.126495 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-3cba5c1d-2b78-4a35-ba0e-f9a8e9849e04 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:28.142585 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3cba5c1d-2b78-4a35-ba0e-f9a8e9849e04 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1278 microversion: 2.1 time: 0.106051 Jul 07 15:44:28.154839 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 575/1158] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:28 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:44:28.154839 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:28.154839 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:28.162688 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:28.162908 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:28.163653 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:28.164087 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:28.197164 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:28.197611 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:28.198295 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lazy-loading 'fault' on Instance uuid de1cc41e-3a12-4fdc-9cec-0cf589c82e21 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:44:28.250362 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:28.258042 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4e5d0fac-4a87-421d-9283-c6d651570212 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 200 len: 1229 microversion: 2.1 time: 0.110318 Jul 07 15:44:28.258940 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 576/1159] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:28 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 1229 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:28.402782 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-a6306f75-a9f4-4927-b8d9-ca5bd083bbfe tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "POST /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/action" status: 202 len: 0 microversion: 2.1 time: 0.710941 Jul 07 15:44:28.404789 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 584/1160] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Jul 7 15:44:27 2022] POST /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:44:28.524215 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-492615ab-df39-4305-908b-9888e69c0ad0 req-7092ac19-9c1f-4213-98af-fe48b47d327d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66906c69-cb44-49e3-ba9b-59dffb9f6181", "tag": "03660176-9b44-4590-8337-3977dc2d927b"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:28.537357 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-492615ab-df39-4305-908b-9888e69c0ad0 req-7092ac19-9c1f-4213-98af-fe48b47d327d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:28.537866 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-492615ab-df39-4305-908b-9888e69c0ad0 req-7092ac19-9c1f-4213-98af-fe48b47d327d service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:28.551466 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-492615ab-df39-4305-908b-9888e69c0ad0 req-7092ac19-9c1f-4213-98af-fe48b47d327d service nova] Creating event network-changed:03660176-9b44-4590-8337-3977dc2d927b for instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 on hv-cinder-84130 Jul 07 15:44:28.563198 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-492615ab-df39-4305-908b-9888e69c0ad0 req-7092ac19-9c1f-4213-98af-fe48b47d327d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150848 Jul 07 15:44:28.564130 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 577/1161] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:29.162942 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-befc0fa5-54e3-4bdd-83c0-30dd53b556f4 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:29.163544 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-befc0fa5-54e3-4bdd-83c0-30dd53b556f4 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:29.169994 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-befc0fa5-54e3-4bdd-83c0-30dd53b556f4 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:29.170518 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-befc0fa5-54e3-4bdd-83c0-30dd53b556f4 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:29.171388 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-befc0fa5-54e3-4bdd-83c0-30dd53b556f4 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:29.172086 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-befc0fa5-54e3-4bdd-83c0-30dd53b556f4 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:29.282412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:29.283833 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: de1cc41e-3a12-4fdc-9cec-0cf589c82e21] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:29.290449 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:29.291107 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:29.292105 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:29.292547 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:29.306659 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] HTTP exception thrown: Instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 could not be found. Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Request method failure captured: Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 HTTP/1.1 Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv2QBV1I8w1TkM9ctiY1d6US8ZrjKh8NBeDoZU9A_t-HOeq0i8yywrMjxh96-1M2y7HshcGyGet4c2m-aNx5O07GBQ47EjI5PRoO5EsELzYabLG4HbXsvgq2jKygLB1ZoDt6c8-9NsctnCRg6LBEvEVMYz-9JUHzUsV-_DE-v3UMcmI Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:44:29.309427 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b72dae7a2e644460b4c63da884023c82", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 05e0f1ddeb224677b18cfc769dc45d47 Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 could not be found. Jul 07 15:44:29.310942 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'de1cc41e-3a12-4fdc-9cec-0cf589c82e21'} Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 could not be found. Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:44:29.312238 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 could not be found. Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 could not be found. Jul 07 15:44:29.313501 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:29.314633 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Returning 404 to user: Instance de1cc41e-3a12-4fdc-9cec-0cf589c82e21 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:44:29.314633 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-7949f80a-354d-4d28-9e22-2ed88a161b6f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21" status: 404 len: 111 microversion: 2.1 time: 0.033625 Jul 07 15:44:29.314633 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 578/1162] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:29 2022] GET /compute/v2.1/servers/de1cc41e-3a12-4fdc-9cec-0cf589c82e21 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 15:44:29.329042 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-befc0fa5-54e3-4bdd-83c0-30dd53b556f4 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:29.344034 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-befc0fa5-54e3-4bdd-83c0-30dd53b556f4 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1318 microversion: 2.1 time: 0.185301 Jul 07 15:44:29.344612 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 585/1163] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:29 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:30.262393 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-696ceed7-965b-46b4-ae73-f12047898d72 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:30.263609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-696ceed7-965b-46b4-ae73-f12047898d72 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:30.265986 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-dc88c6d5-9243-45c6-8b7c-1302da1ee61f req-8ff1af50-4b6f-4a2c-b32d-10c8a198f908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66906c69-cb44-49e3-ba9b-59dffb9f6181", "tag": "03660176-9b44-4590-8337-3977dc2d927b"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:30.270835 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-696ceed7-965b-46b4-ae73-f12047898d72 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:30.271687 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-696ceed7-965b-46b4-ae73-f12047898d72 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:30.272679 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-696ceed7-965b-46b4-ae73-f12047898d72 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:30.273684 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-696ceed7-965b-46b4-ae73-f12047898d72 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:30.277537 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-dc88c6d5-9243-45c6-8b7c-1302da1ee61f req-8ff1af50-4b6f-4a2c-b32d-10c8a198f908 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:30.278496 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-dc88c6d5-9243-45c6-8b7c-1302da1ee61f req-8ff1af50-4b6f-4a2c-b32d-10c8a198f908 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:30.293185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-dc88c6d5-9243-45c6-8b7c-1302da1ee61f req-8ff1af50-4b6f-4a2c-b32d-10c8a198f908 service nova] Creating event network-changed:03660176-9b44-4590-8337-3977dc2d927b for instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 on hv-cinder-84130 Jul 07 15:44:30.299511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-dc88c6d5-9243-45c6-8b7c-1302da1ee61f req-8ff1af50-4b6f-4a2c-b32d-10c8a198f908 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037410 Jul 07 15:44:30.300767 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 586/1164] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:30.365700 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-79597cd1-0f74-4db9-9f82-a517c2d65b2d tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:30.366684 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-79597cd1-0f74-4db9-9f82-a517c2d65b2d tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:30.378241 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-696ceed7-965b-46b4-ae73-f12047898d72 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lazy-loading 'services' on Instance uuid 66906c69-cb44-49e3-ba9b-59dffb9f6181 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:44:30.380483 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-79597cd1-0f74-4db9-9f82-a517c2d65b2d tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:30.381053 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-79597cd1-0f74-4db9-9f82-a517c2d65b2d tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:30.382006 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-79597cd1-0f74-4db9-9f82-a517c2d65b2d tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:30.387242 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-79597cd1-0f74-4db9-9f82-a517c2d65b2d tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:30.631789 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-696ceed7-965b-46b4-ae73-f12047898d72 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments/d0a14d87-df28-40fd-bf56-bb3167999ba0" status: 202 len: 0 microversion: 2.1 time: 0.372467 Jul 07 15:44:30.633218 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 579/1165] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:44:30 2022] DELETE /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments/d0a14d87-df28-40fd-bf56-bb3167999ba0 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:44:30.652135 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-26bad83a-1bd1-43d0-938b-bfeb39d17985 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:30.654508 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-26bad83a-1bd1-43d0-938b-bfeb39d17985 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:30.662125 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-26bad83a-1bd1-43d0-938b-bfeb39d17985 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:30.662878 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-26bad83a-1bd1-43d0-938b-bfeb39d17985 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:30.663858 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-26bad83a-1bd1-43d0-938b-bfeb39d17985 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:30.664442 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-26bad83a-1bd1-43d0-938b-bfeb39d17985 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:30.694424 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-79597cd1-0f74-4db9-9f82-a517c2d65b2d tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:30.702938 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-79597cd1-0f74-4db9-9f82-a517c2d65b2d tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1318 microversion: 2.1 time: 0.342032 Jul 07 15:44:30.706503 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 587/1166] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:30 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:44:30.714659 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-26bad83a-1bd1-43d0-938b-bfeb39d17985 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077109 Jul 07 15:44:30.718906 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 580/1167] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:44:30 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:44:31.723127 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-53da2b2b-9095-4b46-bf0f-04c2e89f0d77 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:31.724297 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-53da2b2b-9095-4b46-bf0f-04c2e89f0d77 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:31.730738 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-5200f691-a864-4119-9e22-ee5d9a1d456b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:31.731682 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-5200f691-a864-4119-9e22-ee5d9a1d456b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:31.741195 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-53da2b2b-9095-4b46-bf0f-04c2e89f0d77 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:31.741380 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5200f691-a864-4119-9e22-ee5d9a1d456b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:31.741380 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5200f691-a864-4119-9e22-ee5d9a1d456b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:31.741560 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-53da2b2b-9095-4b46-bf0f-04c2e89f0d77 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:31.741655 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5200f691-a864-4119-9e22-ee5d9a1d456b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:31.742171 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-53da2b2b-9095-4b46-bf0f-04c2e89f0d77 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:31.742263 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-5200f691-a864-4119-9e22-ee5d9a1d456b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:31.742345 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-53da2b2b-9095-4b46-bf0f-04c2e89f0d77 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:31.773573 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-5200f691-a864-4119-9e22-ee5d9a1d456b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046686 Jul 07 15:44:31.774145 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 581/1168] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:44:31 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:31.950440 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-53da2b2b-9095-4b46-bf0f-04c2e89f0d77 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:31.958285 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-53da2b2b-9095-4b46-bf0f-04c2e89f0d77 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1318 microversion: 2.1 time: 0.238976 Jul 07 15:44:31.958952 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 588/1169] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:31 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:32.313979 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-3154d23a-00c3-4d4d-ac42-31ac3667f944 req-684f189e-6daa-44ca-9449-47db07e66c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dae0ff-9bff-4f62-bacb-6f43395d09c7", "tag": "c8b870e5-16f4-486e-94b8-25407c45ae78"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:32.322063 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-3154d23a-00c3-4d4d-ac42-31ac3667f944 req-684f189e-6daa-44ca-9449-47db07e66c51 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:32.322609 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-3154d23a-00c3-4d4d-ac42-31ac3667f944 req-684f189e-6daa-44ca-9449-47db07e66c51 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:32.335523 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-3154d23a-00c3-4d4d-ac42-31ac3667f944 req-684f189e-6daa-44ca-9449-47db07e66c51 service nova] Creating event network-changed:c8b870e5-16f4-486e-94b8-25407c45ae78 for instance b5dae0ff-9bff-4f62-bacb-6f43395d09c7 on hv-cinder-84130 Jul 07 15:44:32.340586 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-3154d23a-00c3-4d4d-ac42-31ac3667f944 req-684f189e-6daa-44ca-9449-47db07e66c51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030580 Jul 07 15:44:32.341430 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 582/1170] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:32.786096 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-dd438dd1-07ff-4b4c-8867-092f12e2f185 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:32.787030 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-dd438dd1-07ff-4b4c-8867-092f12e2f185 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:32.794282 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dd438dd1-07ff-4b4c-8867-092f12e2f185 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:32.794727 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dd438dd1-07ff-4b4c-8867-092f12e2f185 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:32.795657 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dd438dd1-07ff-4b4c-8867-092f12e2f185 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:32.796773 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-dd438dd1-07ff-4b4c-8867-092f12e2f185 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:32.826861 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-dd438dd1-07ff-4b4c-8867-092f12e2f185 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044900 Jul 07 15:44:32.827973 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 589/1171] 10.222.0.25 () {58 vars in 1301 bytes} [Thu Jul 7 15:44:32 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 15:44:32.839200 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:32.839929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:32.848796 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:32.849354 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:32.850244 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:32.851033 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:32.928371 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] HTTP exception thrown: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 is not attached to volume d0a14d87-df28-40fd-bf56-bb3167999ba0 Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Request method failure captured: Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: DELETE /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments/d0a14d87-df28-40fd-bf56-bb3167999ba0 HTTP/1.1 Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv669QSeeIcyyAWGP9UcxXpFA8BBZUzx3qnCFsk_m0nKOHqi6zVSMWWk1ETDbOqQWx8oGQjTeq9_DtkJeyygio8j6Od_mSFQIygAaAVBaCw_y0kahAUVoesgePCAr9mLrzfBaFhAmBRUjTdXWKjMJD4NbHTCaNhkMQHugXAfBp25SXM Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 0b2770b1b56d4f0ea8c3c1759a8e504f Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-TestMinimumBasicScenario-1120303594 Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:44:32.930722 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b2770b1b56d4f0ea8c3c1759a8e504f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b2770b1b56d4f0ea8c3c1759a8e504f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b2770b1b56d4f0ea8c3c1759a8e504f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b2770b1b56d4f0ea8c3c1759a8e504f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-TestMinimumBasicScenario-1120303594 Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 0b2770b1b56d4f0ea8c3c1759a8e504f Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1120303594 Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-TestMinimumBasicScenario-1120303594-project Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 975faecf991a41f4b116537b39e04d3c Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-TestMinimumBasicScenario-1120303594-project Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:44:32.932446 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 is not attached to volume d0a14d87-df28-40fd-bf56-bb3167999ba0 Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'server_id': '66906c69-cb44-49e3-ba9b-59dffb9f6181', 'id': 'd0a14d87-df28-40fd-bf56-bb3167999ba0'} Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d0a14d87-df28-40fd-bf56-bb3167999ba0. Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:44:32.934080 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 is not attached to volume d0a14d87-df28-40fd-bf56-bb3167999ba0 Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 is not attached to volume d0a14d87-df28-40fd-bf56-bb3167999ba0 Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:32.935529 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Returning 404 to user: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 is not attached to volume d0a14d87-df28-40fd-bf56-bb3167999ba0 {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:44:32.936748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-fce4f954-2f99-4be1-a4c0-6ee4ae38e30e tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments/d0a14d87-df28-40fd-bf56-bb3167999ba0" status: 404 len: 154 microversion: 2.1 time: 0.097574 Jul 07 15:44:32.936748 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 583/1172] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:44:32 2022] DELETE /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181/os-volume_attachments/d0a14d87-df28-40fd-bf56-bb3167999ba0 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:44:32.976244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-874c19ee-0fbc-4d17-9356-79b6da2f991f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:32.976914 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-874c19ee-0fbc-4d17-9356-79b6da2f991f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:32.983015 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-874c19ee-0fbc-4d17-9356-79b6da2f991f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:32.985540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-874c19ee-0fbc-4d17-9356-79b6da2f991f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:32.985540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-874c19ee-0fbc-4d17-9356-79b6da2f991f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:32.985540 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-874c19ee-0fbc-4d17-9356-79b6da2f991f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:33.003261 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e7419292-422b-40e1-8e1d-e441cda06372 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:33.003782 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e7419292-422b-40e1-8e1d-e441cda06372 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:33.012614 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e7419292-422b-40e1-8e1d-e441cda06372 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:33.014125 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e7419292-422b-40e1-8e1d-e441cda06372 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:33.014373 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e7419292-422b-40e1-8e1d-e441cda06372 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:33.015441 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e7419292-422b-40e1-8e1d-e441cda06372 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:33.045543 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e7419292-422b-40e1-8e1d-e441cda06372 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Going to try to terminate instance {{(pid=124720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:44:33.135032 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-874c19ee-0fbc-4d17-9356-79b6da2f991f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:33.153293 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-874c19ee-0fbc-4d17-9356-79b6da2f991f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1318 microversion: 2.1 time: 0.182013 Jul 07 15:44:33.157753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 590/1173] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:32 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:33.160374 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-105c1287-c10c-42df-bca8-5ff824d6af26 req-d884c243-ae00-4790-b7a2-1fd43ec4b103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3287e24c-ce40-4bc8-95ac-3361e15b5807", "tag": "697451eb-ff82-4b0c-b64d-5fb8cde5a13f"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:33.169006 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-105c1287-c10c-42df-bca8-5ff824d6af26 req-d884c243-ae00-4790-b7a2-1fd43ec4b103 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:33.169185 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-105c1287-c10c-42df-bca8-5ff824d6af26 req-d884c243-ae00-4790-b7a2-1fd43ec4b103 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:33.180698 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-105c1287-c10c-42df-bca8-5ff824d6af26 req-d884c243-ae00-4790-b7a2-1fd43ec4b103 service nova] Creating event network-changed:697451eb-ff82-4b0c-b64d-5fb8cde5a13f for instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 on hv-cinder-84130 Jul 07 15:44:33.185691 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-105c1287-c10c-42df-bca8-5ff824d6af26 req-d884c243-ae00-4790-b7a2-1fd43ec4b103 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030547 Jul 07 15:44:33.187176 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 591/1174] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:33.288053 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e7419292-422b-40e1-8e1d-e441cda06372 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 204 len: 0 microversion: 2.1 time: 0.288416 Jul 07 15:44:33.298014 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c5086c35-0fb0-429d-9563-867762e9fce0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:33.298718 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c5086c35-0fb0-429d-9563-867762e9fce0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:33.301567 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 584/1175] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:44:32 2022] DELETE /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 07 15:44:33.305511 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c5086c35-0fb0-429d-9563-867762e9fce0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:33.305965 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c5086c35-0fb0-429d-9563-867762e9fce0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:33.306741 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c5086c35-0fb0-429d-9563-867762e9fce0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:33.307171 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c5086c35-0fb0-429d-9563-867762e9fce0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:33.446948 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c5086c35-0fb0-429d-9563-867762e9fce0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:33.455303 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c5086c35-0fb0-429d-9563-867762e9fce0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1574 microversion: 2.1 time: 0.161719 Jul 07 15:44:33.456433 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 592/1176] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:33 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:34.173150 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ef4d849e-9e7f-498d-aad5-c8d1f9febdf8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:34.173846 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ef4d849e-9e7f-498d-aad5-c8d1f9febdf8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:34.180372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef4d849e-9e7f-498d-aad5-c8d1f9febdf8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:34.180818 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef4d849e-9e7f-498d-aad5-c8d1f9febdf8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:34.181570 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef4d849e-9e7f-498d-aad5-c8d1f9febdf8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:34.182000 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ef4d849e-9e7f-498d-aad5-c8d1f9febdf8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:34.220239 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-ec8d8458-24f9-4f70-b7ef-25f7963ebf7f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:34.220747 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ec8d8458-24f9-4f70-b7ef-25f7963ebf7f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:34.227415 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec8d8458-24f9-4f70-b7ef-25f7963ebf7f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:34.227899 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec8d8458-24f9-4f70-b7ef-25f7963ebf7f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:34.228664 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec8d8458-24f9-4f70-b7ef-25f7963ebf7f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:34.229094 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-ec8d8458-24f9-4f70-b7ef-25f7963ebf7f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:34.255936 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-ec8d8458-24f9-4f70-b7ef-25f7963ebf7f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:44:34.282889 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:34.312195 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ef4d849e-9e7f-498d-aad5-c8d1f9febdf8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:34.319951 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ef4d849e-9e7f-498d-aad5-c8d1f9febdf8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1318 microversion: 2.1 time: 0.150988 Jul 07 15:44:34.320549 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 585/1177] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:34 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:34.473250 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-faebcf17-248c-4816-92c2-435571ed3712 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:34.473778 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-faebcf17-248c-4816-92c2-435571ed3712 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:34.479794 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-faebcf17-248c-4816-92c2-435571ed3712 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:34.480232 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-faebcf17-248c-4816-92c2-435571ed3712 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:34.480976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-faebcf17-248c-4816-92c2-435571ed3712 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:34.481420 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-faebcf17-248c-4816-92c2-435571ed3712 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:34.501294 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:34.539264 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-ec8d8458-24f9-4f70-b7ef-25f7963ebf7f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 204 len: 0 microversion: 2.1 time: 0.322442 Jul 07 15:44:34.540198 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 593/1178] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:44:34 2022] DELETE /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 07 15:44:34.549310 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-7b1058ec-28a0-4f3b-892c-5ec2ae541f4f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:34.550005 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-7b1058ec-28a0-4f3b-892c-5ec2ae541f4f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:34.556616 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7b1058ec-28a0-4f3b-892c-5ec2ae541f4f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:34.557273 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7b1058ec-28a0-4f3b-892c-5ec2ae541f4f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:34.557814 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7b1058ec-28a0-4f3b-892c-5ec2ae541f4f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:34.558244 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-7b1058ec-28a0-4f3b-892c-5ec2ae541f4f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:34.648986 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-faebcf17-248c-4816-92c2-435571ed3712 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:34.656222 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-faebcf17-248c-4816-92c2-435571ed3712 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1574 microversion: 2.1 time: 0.186952 Jul 07 15:44:34.657637 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 586/1179] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:34 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:44:34.710421 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-7b1058ec-28a0-4f3b-892c-5ec2ae541f4f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:34.717970 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-7b1058ec-28a0-4f3b-892c-5ec2ae541f4f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1554 microversion: 2.1 time: 0.173515 Jul 07 15:44:34.718532 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 594/1180] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:34 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:35.337561 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-55f11493-3b65-4236-bc94-00690932be8e tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:35.338193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-55f11493-3b65-4236-bc94-00690932be8e tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:35.346002 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55f11493-3b65-4236-bc94-00690932be8e tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:35.346495 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55f11493-3b65-4236-bc94-00690932be8e tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:35.347319 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55f11493-3b65-4236-bc94-00690932be8e tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:35.347780 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-55f11493-3b65-4236-bc94-00690932be8e tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:35.477958 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-55f11493-3b65-4236-bc94-00690932be8e tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:35.485801 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-55f11493-3b65-4236-bc94-00690932be8e tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1318 microversion: 2.1 time: 0.152093 Jul 07 15:44:35.486299 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 587/1181] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:35 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:35.674125 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0904eabd-52e0-4fdc-a60b-8307be05c941 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:35.674739 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0904eabd-52e0-4fdc-a60b-8307be05c941 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:35.682352 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0904eabd-52e0-4fdc-a60b-8307be05c941 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:35.682802 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0904eabd-52e0-4fdc-a60b-8307be05c941 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:35.683559 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0904eabd-52e0-4fdc-a60b-8307be05c941 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:35.684020 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0904eabd-52e0-4fdc-a60b-8307be05c941 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:35.735760 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ab72b4cc-5f34-465a-897e-d79de151dfc0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:35.736408 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ab72b4cc-5f34-465a-897e-d79de151dfc0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:35.738165 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=2 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:35.743175 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ab72b4cc-5f34-465a-897e-d79de151dfc0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:35.743639 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ab72b4cc-5f34-465a-897e-d79de151dfc0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:35.744386 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ab72b4cc-5f34-465a-897e-d79de151dfc0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:35.744812 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ab72b4cc-5f34-465a-897e-d79de151dfc0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:35.855249 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0904eabd-52e0-4fdc-a60b-8307be05c941 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:35.863317 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0904eabd-52e0-4fdc-a60b-8307be05c941 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1574 microversion: 2.1 time: 0.193285 Jul 07 15:44:35.863927 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 595/1182] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:35 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:35.899293 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ab72b4cc-5f34-465a-897e-d79de151dfc0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:35.906737 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ab72b4cc-5f34-465a-897e-d79de151dfc0 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1554 microversion: 2.1 time: 0.174781 Jul 07 15:44:35.907366 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 588/1183] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:35 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:44:36.503314 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-da961dd7-892e-4744-8006-27c5910aa632 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:36.503947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-da961dd7-892e-4744-8006-27c5910aa632 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:36.509947 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-da961dd7-892e-4744-8006-27c5910aa632 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:36.510393 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-da961dd7-892e-4744-8006-27c5910aa632 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:36.511153 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-da961dd7-892e-4744-8006-27c5910aa632 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:36.511602 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-da961dd7-892e-4744-8006-27c5910aa632 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:36.643036 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-da961dd7-892e-4744-8006-27c5910aa632 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:36.650966 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-da961dd7-892e-4744-8006-27c5910aa632 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1318 microversion: 2.1 time: 0.152176 Jul 07 15:44:36.659753 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 596/1184] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:36 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:36.883234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-99fbeea3-4f62-4009-a549-fb0b6947ae33 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:36.883234 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-99fbeea3-4f62-4009-a549-fb0b6947ae33 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:36.884195 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell0:SELECT=8 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:36.889551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-99fbeea3-4f62-4009-a549-fb0b6947ae33 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:36.890194 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-99fbeea3-4f62-4009-a549-fb0b6947ae33 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:36.891029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-99fbeea3-4f62-4009-a549-fb0b6947ae33 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:36.891522 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-99fbeea3-4f62-4009-a549-fb0b6947ae33 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:36.925235 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-d0abd3aa-22ec-473e-80ce-45399c238bf6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:36.925776 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-d0abd3aa-22ec-473e-80ce-45399c238bf6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:36.946929 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0abd3aa-22ec-473e-80ce-45399c238bf6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:36.947477 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0abd3aa-22ec-473e-80ce-45399c238bf6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:36.955853 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0abd3aa-22ec-473e-80ce-45399c238bf6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:36.956396 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-d0abd3aa-22ec-473e-80ce-45399c238bf6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:37.160601 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-99fbeea3-4f62-4009-a549-fb0b6947ae33 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:37.168744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-99fbeea3-4f62-4009-a549-fb0b6947ae33 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1456 microversion: 2.1 time: 0.291575 Jul 07 15:44:37.170262 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 589/1185] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:36 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1456 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:37.203765 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-d0abd3aa-22ec-473e-80ce-45399c238bf6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:37.211541 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-d0abd3aa-22ec-473e-80ce-45399c238bf6 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1554 microversion: 2.1 time: 0.291755 Jul 07 15:44:37.212131 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 597/1186] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:36 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1554 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:44:37.248492 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-a3c11ba4-96d2-4040-8fa3-cb1882af7fee req-d3d602ad-61b6-4a25-942e-00cec4a0fb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dae0ff-9bff-4f62-bacb-6f43395d09c7", "name": "network-vif-plugged", "status": "completed", "tag": "c8b870e5-16f4-486e-94b8-25407c45ae78"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:37.258222 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-a3c11ba4-96d2-4040-8fa3-cb1882af7fee req-d3d602ad-61b6-4a25-942e-00cec4a0fb3a service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:37.258668 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-a3c11ba4-96d2-4040-8fa3-cb1882af7fee req-d3d602ad-61b6-4a25-942e-00cec4a0fb3a service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:37.274178 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-a3c11ba4-96d2-4040-8fa3-cb1882af7fee req-d3d602ad-61b6-4a25-942e-00cec4a0fb3a service nova] Creating event network-vif-plugged:c8b870e5-16f4-486e-94b8-25407c45ae78 for instance b5dae0ff-9bff-4f62-bacb-6f43395d09c7 on hv-cinder-84130 Jul 07 15:44:37.282959 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-a3c11ba4-96d2-4040-8fa3-cb1882af7fee req-d3d602ad-61b6-4a25-942e-00cec4a0fb3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103454 Jul 07 15:44:37.284280 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 590/1187] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:37.322600 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [req-1e576d6e-7426-4cae-9829-e49dd833e1cf req-ee7df03e-7516-4a8f-92cd-814f4f78e163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66906c69-cb44-49e3-ba9b-59dffb9f6181", "name": "network-vif-deleted", "tag": "03660176-9b44-4590-8337-3977dc2d927b"}]} {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:37.336850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-1e576d6e-7426-4cae-9829-e49dd833e1cf req-ee7df03e-7516-4a8f-92cd-814f4f78e163 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:37.339926 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [req-1e576d6e-7426-4cae-9829-e49dd833e1cf req-ee7df03e-7516-4a8f-92cd-814f4f78e163 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:37.372354 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.compute.server_external_events [req-1e576d6e-7426-4cae-9829-e49dd833e1cf req-ee7df03e-7516-4a8f-92cd-814f4f78e163 service nova] Creating event network-vif-deleted:03660176-9b44-4590-8337-3977dc2d927b for instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 on hv-cinder-84130 Jul 07 15:44:37.380460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [req-1e576d6e-7426-4cae-9829-e49dd833e1cf req-ee7df03e-7516-4a8f-92cd-814f4f78e163 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064055 Jul 07 15:44:37.380460 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 598/1188] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:37.386216 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-7b2fa686-448f-4ef1-b0d1-3b03031b500b req-85427c0e-c9f2-4ac8-88c5-862dcd0704c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3287e24c-ce40-4bc8-95ac-3361e15b5807", "name": "network-vif-deleted", "tag": "697451eb-ff82-4b0c-b64d-5fb8cde5a13f"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:37.396438 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-7b2fa686-448f-4ef1-b0d1-3b03031b500b req-85427c0e-c9f2-4ac8-88c5-862dcd0704c5 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:37.396919 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-7b2fa686-448f-4ef1-b0d1-3b03031b500b req-85427c0e-c9f2-4ac8-88c5-862dcd0704c5 service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:37.408316 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-7b2fa686-448f-4ef1-b0d1-3b03031b500b req-85427c0e-c9f2-4ac8-88c5-862dcd0704c5 service nova] Creating event network-vif-deleted:697451eb-ff82-4b0c-b64d-5fb8cde5a13f for instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 on hv-cinder-84130 Jul 07 15:44:37.413388 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-7b2fa686-448f-4ef1-b0d1-3b03031b500b req-85427c0e-c9f2-4ac8-88c5-862dcd0704c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031273 Jul 07 15:44:37.413955 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 591/1189] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:44:37.669878 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c89b4f5f-09a6-434b-9046-80fbf6bf856b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:37.670324 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c89b4f5f-09a6-434b-9046-80fbf6bf856b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:37.677391 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c89b4f5f-09a6-434b-9046-80fbf6bf856b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:37.678140 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c89b4f5f-09a6-434b-9046-80fbf6bf856b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:37.679250 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c89b4f5f-09a6-434b-9046-80fbf6bf856b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:37.679863 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c89b4f5f-09a6-434b-9046-80fbf6bf856b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:37.828134 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c89b4f5f-09a6-434b-9046-80fbf6bf856b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:37.836452 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c89b4f5f-09a6-434b-9046-80fbf6bf856b tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1318 microversion: 2.1 time: 0.172007 Jul 07 15:44:37.837027 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 599/1190] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:37 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:38.186834 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:38.187544 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:38.195098 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:38.195541 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:38.196308 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:38.196733 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:38.226496 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:38.226932 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:38.227371 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lazy-loading 'fault' on Instance uuid 3287e24c-ce40-4bc8-95ac-3361e15b5807 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:44:38.229578 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:38.230208 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:38.237023 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:38.237465 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:38.238224 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:38.238651 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:38.269882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e0f1ddeb224677b18cfc769dc45d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72dae7a2e644460b4c63da884023c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:38.271231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:38.271699 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:38.272157 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.objects.instance [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lazy-loading 'fault' on Instance uuid 66906c69-cb44-49e3-ba9b-59dffb9f6181 {{(pid=124719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:44:38.277545 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-e497a65b-650b-4414-b280-c6bbedc24309 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 200 len: 1228 microversion: 2.1 time: 0.094937 Jul 07 15:44:38.278108 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 592/1191] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:38 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:38.315695 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975faecf991a41f4b116537b39e04d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2770b1b56d4f0ea8c3c1759a8e504f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:38.322983 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c3d62fba-26d4-4ac1-ad06-0118e7aab51f tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 200 len: 1348 microversion: 2.1 time: 0.097248 Jul 07 15:44:38.323547 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 600/1192] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:38 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 15:44:38.853140 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-ecbee9e5-f785-4bf5-9a29-f0a73e1da225 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:38.853744 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-ecbee9e5-f785-4bf5-9a29-f0a73e1da225 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:38.859932 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ecbee9e5-f785-4bf5-9a29-f0a73e1da225 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:38.865673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ecbee9e5-f785-4bf5-9a29-f0a73e1da225 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:38.865673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ecbee9e5-f785-4bf5-9a29-f0a73e1da225 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:38.865673 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-ecbee9e5-f785-4bf5-9a29-f0a73e1da225 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:38.992193 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-ecbee9e5-f785-4bf5-9a29-f0a73e1da225 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:38.999804 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-ecbee9e5-f785-4bf5-9a29-f0a73e1da225 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1318 microversion: 2.1 time: 0.150503 Jul 07 15:44:39.000412 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 593/1193] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:38 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:39.294726 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:39.295270 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 3287e24c-ce40-4bc8-95ac-3361e15b5807] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:39.301637 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:39.302079 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:39.302897 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:39.303339 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:39.317516 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.wsgi [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] HTTP exception thrown: Instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 could not be found. Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Request method failure captured: Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: request: GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 HTTP/1.1 Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept: application/json Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Accept-Encoding: identity Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Connection: close Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Length: 0 Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Content-Type: application/json Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Host: 10.222.0.25 Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Openstack-System-Scope: None Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: User-Agent: python-urllib3/1.26.9 Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Auth-Token: gAAAAABixv2QBV1I8w1TkM9ctiY1d6US8ZrjKh8NBeDoZU9A_t-HOeq0i8yywrMjxh96-1M2y7HshcGyGet4c2m-aNx5O07GBQ47EjI5PRoO5EsELzYabLG4HbXsvgq2jKygLB1ZoDt6c8-9NsctnCRg6LBEvEVMYz-9JUHzUsV-_DE-v3UMcmI Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Id: None Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Domain-Name: None Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Identity-Status: Confirmed Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Is-Admin-Project: True Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Id: default Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Domain-Name: Default Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Project-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Role: member,reader Jul 07 15:44:39.319196 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Roles: member,reader Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b72dae7a2e644460b4c63da884023c82", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Id: default Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Domain-Name: Default Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Id: 05e0f1ddeb224677b18cfc769dc45d47 Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: X-User-Name: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: method: > Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: exception: Instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 could not be found. Jul 07 15:44:39.320964 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: action_args: {'id': '3287e24c-ce40-4bc8-95ac-3361e15b5807'} Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 could not be found. Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:44:39.322098 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 could not be found. Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 could not be found. Jul 07 15:44:39.323730 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.325187 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Returning 404 to user: Instance 3287e24c-ce40-4bc8-95ac-3361e15b5807 could not be found. {{(pid=124719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:44:39.325187 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0482a8f8-3522-4ca2-a00b-973f50fe816f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807" status: 404 len: 111 microversion: 2.1 time: 0.029921 Jul 07 15:44:39.325187 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 601/1194] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:39 2022] GET /compute/v2.1/servers/3287e24c-ce40-4bc8-95ac-3361e15b5807 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:44:39.341029 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:39.341624 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [instance: 66906c69-cb44-49e3-ba9b-59dffb9f6181] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:39.348463 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:39.348977 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:39.349755 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:39.350186 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:39.363956 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] HTTP exception thrown: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 could not be found. Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Request method failure captured: Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 HTTP/1.1 Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv669QSeeIcyyAWGP9UcxXpFA8BBZUzx3qnCFsk_m0nKOHqi6zVSMWWk1ETDbOqQWx8oGQjTeq9_DtkJeyygio8j6Od_mSFQIygAaAVBaCw_y0kahAUVoesgePCAr9mLrzfBaFhAmBRUjTdXWKjMJD4NbHTCaNhkMQHugXAfBp25SXM Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: 0b2770b1b56d4f0ea8c3c1759a8e504f Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-TestMinimumBasicScenario-1120303594 Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:44:39.365910 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b2770b1b56d4f0ea8c3c1759a8e504f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b2770b1b56d4f0ea8c3c1759a8e504f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b2770b1b56d4f0ea8c3c1759a8e504f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b2770b1b56d4f0ea8c3c1759a8e504f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-TestMinimumBasicScenario-1120303594 Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: 0b2770b1b56d4f0ea8c3c1759a8e504f Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1120303594 Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-TestMinimumBasicScenario-1120303594-project Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 975faecf991a41f4b116537b39e04d3c Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-TestMinimumBasicScenario-1120303594-project Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 could not be found. Jul 07 15:44:39.367602 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '66906c69-cb44-49e3-ba9b-59dffb9f6181'} Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 could not be found. Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:44:39.368632 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 could not be found. Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 could not be found. Jul 07 15:44:39.370191 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.371551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Returning 404 to user: Instance 66906c69-cb44-49e3-ba9b-59dffb9f6181 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:44:39.371551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-66174f8e-98e8-4f3f-8c1d-44159bc0766b tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181" status: 404 len: 111 microversion: 2.1 time: 0.030160 Jul 07 15:44:39.371551 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 594/1195] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:39 2022] GET /compute/v2.1/servers/66906c69-cb44-49e3-ba9b-59dffb9f6181 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:44:39.377612 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-637ce4fb-d03a-4d14-af27-eeb1415e1506 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] Calling method '.version_select at 0x7f52495943a0>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:39.380850 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-637ce4fb-d03a-4d14-af27-eeb1415e1506 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [71e2ad1d-96dc-44e6-b85a-1331a707ce12] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 07 15:44:39.840163 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:39.840660 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:39.846659 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:39.847102 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:39.847890 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:39.848323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:39.861880 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] HTTP exception thrown: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Request method failure captured: Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: DELETE /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 HTTP/1.1 Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv2QBV1I8w1TkM9ctiY1d6US8ZrjKh8NBeDoZU9A_t-HOeq0i8yywrMjxh96-1M2y7HshcGyGet4c2m-aNx5O07GBQ47EjI5PRoO5EsELzYabLG4HbXsvgq2jKygLB1ZoDt6c8-9NsctnCRg6LBEvEVMYz-9JUHzUsV-_DE-v3UMcmI Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:44:39.863387 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b72dae7a2e644460b4c63da884023c82", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 05e0f1ddeb224677b18cfc769dc45d47 Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.865318 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '32392277-48d3-4a76-8afe-0df0a333ef33'} Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:44:39.866257 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.867901 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.869434 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Returning 404 to user: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:44:39.869434 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-4e50034e-fa5c-4f08-9360-0faed418fb71 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "DELETE /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 404 len: 111 microversion: 2.1 time: 0.028966 Jul 07 15:44:39.869434 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 595/1196] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:44:39 2022] DELETE /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 15:44:39.872881 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:39.873475 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] [instance: 32392277-48d3-4a76-8afe-0df0a333ef33] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:39.879670 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:39.880116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:39.880857 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:39.881286 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:39.893981 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] HTTP exception thrown: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Request method failure captured: Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 HTTP/1.1 Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv2QBV1I8w1TkM9ctiY1d6US8ZrjKh8NBeDoZU9A_t-HOeq0i8yywrMjxh96-1M2y7HshcGyGet4c2m-aNx5O07GBQ47EjI5PRoO5EsELzYabLG4HbXsvgq2jKygLB1ZoDt6c8-9NsctnCRg6LBEvEVMYz-9JUHzUsV-_DE-v3UMcmI Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:44:39.895429 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b72dae7a2e644460b4c63da884023c82", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b72dae7a2e644460b4c63da884023c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: b72dae7a2e644460b4c63da884023c82 Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640799665 Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: 05e0f1ddeb224677b18cfc769dc45d47 Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-TestVolumeBootPattern-1640799665-project Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.897086 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': '32392277-48d3-4a76-8afe-0df0a333ef33'} Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:44:39.897943 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. Jul 07 15:44:39.899428 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:44:39.900819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Returning 404 to user: Instance 32392277-48d3-4a76-8afe-0df0a333ef33 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:44:39.900819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-43833687-adf1-4b1b-b977-e1e5833378e0 tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33" status: 404 len: 111 microversion: 2.1 time: 0.027354 Jul 07 15:44:39.900819 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 596/1197] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:39 2022] GET /compute/v2.1/servers/32392277-48d3-4a76-8afe-0df0a333ef33 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 15:44:40.016426 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-9f7ac50f-7b38-49c7-9e31-6c2cbc0053d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:40.016976 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-9f7ac50f-7b38-49c7-9e31-6c2cbc0053d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:40.023152 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f7ac50f-7b38-49c7-9e31-6c2cbc0053d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:40.023629 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f7ac50f-7b38-49c7-9e31-6c2cbc0053d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:40.024417 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f7ac50f-7b38-49c7-9e31-6c2cbc0053d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:40.024845 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-9f7ac50f-7b38-49c7-9e31-6c2cbc0053d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:40.157084 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-9f7ac50f-7b38-49c7-9e31-6c2cbc0053d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:44:40.167606 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-9f7ac50f-7b38-49c7-9e31-6c2cbc0053d5 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1508 microversion: 2.1 time: 0.155006 Jul 07 15:44:40.168273 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 597/1198] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:44:40 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:44:40.184956 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-3c6dcd9e-2ccb-4a6f-b491-d98ce38c31ce tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ec3ec6-33cd-4488-a614-0f8faf51376c", "device": "/dev/sdb"}} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:44:40.186698 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-3c6dcd9e-2ccb-4a6f-b491-d98ce38c31ce tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:44:40.192654 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3c6dcd9e-2ccb-4a6f-b491-d98ce38c31ce tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:40.193141 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3c6dcd9e-2ccb-4a6f-b491-d98ce38c31ce tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:40.193882 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3c6dcd9e-2ccb-4a6f-b491-d98ce38c31ce tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:44:40.194317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-3c6dcd9e-2ccb-4a6f-b491-d98ce38c31ce tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:44:40.387461 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO oslo.messaging._drivers.impl_rabbit [None req-637ce4fb-d03a-4d14-af27-eeb1415e1506 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] [71e2ad1d-96dc-44e6-b85a-1331a707ce12] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35714. Jul 07 15:44:40.394349 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:44:40.511359 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-637ce4fb-d03a-4d14-af27-eeb1415e1506 tempest-TestMinimumBasicScenario-1120303594 tempest-TestMinimumBasicScenario-1120303594-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1924457698" status: 202 len: 0 microversion: 2.1 time: 1.139032 Jul 07 15:44:40.511965 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 602/1199] 10.222.0.25 () {58 vars in 1271 bytes} [Thu Jul 7 15:44:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1924457698 => generated 0 bytes in 1140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 15:44:40.931861 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-3c6dcd9e-2ccb-4a6f-b491-d98ce38c31ce tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "POST /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750696 Jul 07 15:44:40.932509 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 598/1200] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Jul 7 15:44:40 2022] POST /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 15:44:41.435184 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-c1dffa63-72e9-4550-b060-bd918141251f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] Calling method '.version_select at 0x7f524954c160>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:44:41.528503 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-c1dffa63-72e9-4550-b060-bd918141251f tempest-TestVolumeBootPattern-1640799665 tempest-TestVolumeBootPattern-1640799665-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-92263573" status: 202 len: 0 microversion: 2.1 time: 0.097774 Jul 07 15:44:41.529088 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 603/1201] 10.222.0.25 () {58 vars in 1256 bytes} [Thu Jul 7 15:44:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-92263573 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:44:53.664854 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:44:53.665466 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Thu Jul 7 15:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:44:58.102223 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:44:58.102688 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Thu Jul 7 15:44:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:45:00.991357 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:45:00.992176 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG dbcounter [-] [124720] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:45:00.996391 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f4cc6eff-ec68-4699-8e24-01bfb9890a25 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:45:00.996973 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f4cc6eff-ec68-4699-8e24-01bfb9890a25 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:45:01.002993 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4cc6eff-ec68-4699-8e24-01bfb9890a25 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:01.006076 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4cc6eff-ec68-4699-8e24-01bfb9890a25 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:01.006076 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4cc6eff-ec68-4699-8e24-01bfb9890a25 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:01.006076 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f4cc6eff-ec68-4699-8e24-01bfb9890a25 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:01.094546 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.objects.instance [None req-f4cc6eff-ec68-4699-8e24-01bfb9890a25 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lazy-loading 'services' on Instance uuid b5dae0ff-9bff-4f62-bacb-6f43395d09c7 {{(pid=124720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 15:45:01.291523 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f4cc6eff-ec68-4699-8e24-01bfb9890a25 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7/os-volume_attachments/f4ec3ec6-33cd-4488-a614-0f8faf51376c" status: 202 len: 0 microversion: 2.1 time: 0.301774 Jul 07 15:45:01.292141 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 599/1202] 10.222.0.25 () {58 vars in 1415 bytes} [Thu Jul 7 15:45:00 2022] DELETE /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7/os-volume_attachments/f4ec3ec6-33cd-4488-a614-0f8faf51376c => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 15:45:02.402171 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=46,nova_cell1:INSERT=1 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:45:02.402990 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG dbcounter [-] [124719] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=2 {{(pid=124719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 15:45:02.407213 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-139f5185-0fde-408c-8c2c-1b2a85f05fb8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:45:02.407763 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-139f5185-0fde-408c-8c2c-1b2a85f05fb8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:45:02.413903 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-139f5185-0fde-408c-8c2c-1b2a85f05fb8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:02.414382 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-139f5185-0fde-408c-8c2c-1b2a85f05fb8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:02.415144 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-139f5185-0fde-408c-8c2c-1b2a85f05fb8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:02.415582 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-139f5185-0fde-408c-8c2c-1b2a85f05fb8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:02.440262 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-139f5185-0fde-408c-8c2c-1b2a85f05fb8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Going to try to terminate instance {{(pid=124719) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 15:45:02.779071 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-139f5185-0fde-408c-8c2c-1b2a85f05fb8 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 204 len: 0 microversion: 2.1 time: 0.378235 Jul 07 15:45:02.779764 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 604/1203] 10.222.0.25 () {58 vars in 1238 bytes} [Thu Jul 7 15:45:02 2022] DELETE /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 15:45:02.789444 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-999316b6-5223-47a1-8f95-5c15b0e63d27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:45:02.792196 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-999316b6-5223-47a1-8f95-5c15b0e63d27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:45:02.797317 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-999316b6-5223-47a1-8f95-5c15b0e63d27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:02.797767 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-999316b6-5223-47a1-8f95-5c15b0e63d27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:02.798531 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-999316b6-5223-47a1-8f95-5c15b0e63d27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:02.798958 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-999316b6-5223-47a1-8f95-5c15b0e63d27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:02.929721 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.policy [None req-999316b6-5223-47a1-8f95-5c15b0e63d27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124720) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:45:02.937124 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-999316b6-5223-47a1-8f95-5c15b0e63d27 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1514 microversion: 2.1 time: 0.152963 Jul 07 15:45:02.937727 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 600/1204] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:45:02 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:45:03.955602 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-60c5581d-7b38-4a5e-82a2-67b5e6972518 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:45:03.956231 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-60c5581d-7b38-4a5e-82a2-67b5e6972518 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:45:03.963342 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-60c5581d-7b38-4a5e-82a2-67b5e6972518 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:03.963813 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-60c5581d-7b38-4a5e-82a2-67b5e6972518 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:03.964584 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-60c5581d-7b38-4a5e-82a2-67b5e6972518 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:03.965023 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-60c5581d-7b38-4a5e-82a2-67b5e6972518 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:04.092958 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-60c5581d-7b38-4a5e-82a2-67b5e6972518 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:45:04.100365 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-60c5581d-7b38-4a5e-82a2-67b5e6972518 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1514 microversion: 2.1 time: 0.149178 Jul 07 15:45:04.100926 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 605/1205] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:45:03 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:45:05.017342 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [req-bb4e3915-99d8-4c24-8cbd-81afa5a74dd1 req-50e4d1f0-2f14-4dc5-8d1d-e3f19184b6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dae0ff-9bff-4f62-bacb-6f43395d09c7", "name": "network-vif-deleted", "tag": "c8b870e5-16f4-486e-94b8-25407c45ae78"}]} {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 15:45:05.025766 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-bb4e3915-99d8-4c24-8cbd-81afa5a74dd1 req-50e4d1f0-2f14-4dc5-8d1d-e3f19184b6df service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:05.026229 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [req-bb4e3915-99d8-4c24-8cbd-81afa5a74dd1 req-50e4d1f0-2f14-4dc5-8d1d-e3f19184b6df service nova] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:05.036958 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.compute.server_external_events [req-bb4e3915-99d8-4c24-8cbd-81afa5a74dd1 req-50e4d1f0-2f14-4dc5-8d1d-e3f19184b6df service nova] Creating event network-vif-deleted:c8b870e5-16f4-486e-94b8-25407c45ae78 for instance b5dae0ff-9bff-4f62-bacb-6f43395d09c7 on hv-cinder-84130 Jul 07 15:45:05.041905 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [req-bb4e3915-99d8-4c24-8cbd-81afa5a74dd1 req-50e4d1f0-2f14-4dc5-8d1d-e3f19184b6df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028231 Jul 07 15:45:05.042474 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 601/1206] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Jul 7 15:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 15:45:05.118131 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.api.openstack.wsgi [None req-0e50dfd2-0639-4aab-a04e-b52152a8b46f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:45:05.118743 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.compute.api [None req-0e50dfd2-0639-4aab-a04e-b52152a8b46f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124719) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:45:05.125296 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0e50dfd2-0639-4aab-a04e-b52152a8b46f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:05.125809 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0e50dfd2-0639-4aab-a04e-b52152a8b46f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:05.129703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0e50dfd2-0639-4aab-a04e-b52152a8b46f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:05.129703 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG oslo_concurrency.lockutils [None req-0e50dfd2-0639-4aab-a04e-b52152a8b46f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:05.189556 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: DEBUG nova.policy [None req-0e50dfd2-0639-4aab-a04e-b52152a8b46f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedbf09a8fe146709e18f019a18854c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd087fee0c67c47f98f424fbdb919b547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124719) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 15:45:05.197795 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO nova.api.openstack.requestlog [None req-0e50dfd2-0639-4aab-a04e-b52152a8b46f tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 200 len: 1472 microversion: 2.1 time: 0.084423 Jul 07 15:45:05.198369 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: [pid: 124719|app: 0|req: 606/1207] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:45:05 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 15:45:06.215303 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Calling method '>' {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 15:45:06.216020 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.compute.api [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] [instance: b5dae0ff-9bff-4f62-bacb-6f43395d09c7] Fetching instance by UUID {{(pid=124720) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 15:45:06.222314 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:06.222712 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:06.223465 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 15:45:06.223929 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG oslo_concurrency.lockutils [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Lock "316eb91c-3dad-4e42-84e1-39a08b9618c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 15:45:06.241021 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.wsgi [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] HTTP exception thrown: Instance b5dae0ff-9bff-4f62-bacb-6f43395d09c7 could not be found. Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Request method failure captured: Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: request: GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 HTTP/1.1 Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept: application/json Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Accept-Encoding: identity Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Connection: close Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Length: 0 Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Content-Type: application/json Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Host: 10.222.0.25 Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Openstack-System-Scope: None Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: User-Agent: python-urllib3/1.26.9 Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Auth-Token: gAAAAABixv8Sj6qUyY4Qzw06Gh6tWK38bZnWNaTofJquwsHTwZQITXvDmFs98TuZ2LDr7L2m-SBzEomnC5DF7O1IV09Pw_0HQ_erAtNnT_dRnD4UFn5F58p0kCZluB7sUOVw6C9f7WoAb3OUoaQoc-A7Tw8O1idYkMmWSGLj_Bg_LoZ74C_-iK8 Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Id: None Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Domain-Name: None Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Identity-Status: Confirmed Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Is-Admin-Project: True Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Id: default Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Domain-Name: Default Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Id: d087fee0c67c47f98f424fbdb919b547 Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1497602297 Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Role: member,reader Jul 07 15:45:06.243259 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Roles: member,reader Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d087fee0c67c47f98f424fbdb919b547", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d087fee0c67c47f98f424fbdb919b547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d087fee0c67c47f98f424fbdb919b547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d087fee0c67c47f98f424fbdb919b547"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant: tempest-VolumesSnapshotTestJSON-1497602297 Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Id: d087fee0c67c47f98f424fbdb919b547 Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1497602297 Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User: tempest-VolumesSnapshotTestJSON-1497602297-project Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Id: default Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Domain-Name: Default Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Id: fedbf09a8fe146709e18f019a18854c6 Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: X-User-Name: tempest-VolumesSnapshotTestJSON-1497602297-project Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: method: > Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: exception: Instance b5dae0ff-9bff-4f62-bacb-6f43395d09c7 could not be found. Jul 07 15:45:06.245030 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: action_args: {'id': 'b5dae0ff-9bff-4f62-bacb-6f43395d09c7'} Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: {{(pid=124720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5dae0ff-9bff-4f62-bacb-6f43395d09c7 could not be found. Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 15:45:06.246116 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5dae0ff-9bff-4f62-bacb-6f43395d09c7 could not be found. Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5dae0ff-9bff-4f62-bacb-6f43395d09c7 could not be found. Jul 07 15:45:06.247815 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: ERROR nova.api.openstack.wsgi Jul 07 15:45:06.249372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: DEBUG nova.api.openstack.wsgi [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] Returning 404 to user: Instance b5dae0ff-9bff-4f62-bacb-6f43395d09c7 could not be found. {{(pid=124720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 15:45:06.249372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO nova.api.openstack.requestlog [None req-f1d4e377-4fe3-4b7a-9130-1e6f6fd2a635 tempest-VolumesSnapshotTestJSON-1497602297 tempest-VolumesSnapshotTestJSON-1497602297-project] 10.222.0.25 "GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7" status: 404 len: 111 microversion: 2.1 time: 0.034149 Jul 07 15:45:06.249372 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: [pid: 124720|app: 0|req: 602/1208] 10.222.0.25 () {58 vars in 1235 bytes} [Thu Jul 7 15:45:06 2022] GET /compute/v2.1/servers/b5dae0ff-9bff-4f62-bacb-6f43395d09c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 15:46:42.123452 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:46:42.124090 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Thu Jul 7 15:46:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:48:13.673323 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:48:13.673930 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Thu Jul 7 15:48:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:48:18.110702 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:48:18.111223 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Thu Jul 7 15:48:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:49:53.445658 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:49:53.446350 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Thu Jul 7 15:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:50:02.133059 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:50:02.133637 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Thu Jul 7 15:50:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:50:08.020832 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:50:08.021399 dv-cinder-841302-5-iscsi devstack@n-api.service[124720]: Thu Jul 7 15:50:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 15:50:23.170063 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 15:50:23.170521 dv-cinder-841302-5-iscsi devstack@n-api.service[124719]: Thu Jul 7 15:50:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!